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Laboratory and was evaluated experimentally in three technical 
training settings. Using input from 1 to 8 video cameras, the system 
provided a flexible combination of signal processing, direct monitor, 
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motion. The system design was based on hypothesized benefits or 
manpower savings in technical training, achieved by the remote and/or 
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Problem 

Performance testing and student monitoring In Individualized training 
are frequently labor Intensive activities. The overall objective of this 
project was to Investigate the feasibility of using low-cost video monitor- 
ing and recording equipment to extend the Instructor's capabilities In both 
testing and monitoring acltlvltles. 

Approach 

Technical training activities at Sheppard Air Force Base, Texas, were 
evaluated and testing activities In jet aircraft training, power produc- 
tion, and Instructor training were selected for study. A detailed analysis 
of the testing areas was conducted and a video system was designed to 
accommodate video monitoring and recording of student testing and training 
activities. The- designed system was then tried out In the training envir- 
onment. 

Results 

Most of the actlvlttes recorded or monitored provided adequate Infor- 
mation to the Instructor to accomplish his tasks. Frequently the video 
provided more Information than was available without tt. There were some 
technical problems associated with using or Installing video equipment, 
ihe video techniques were usable In a wide range of training environments. 

Concl usions 

The use of video monitoring and recording equipment Is feasible In 
many (but not all) training environments and for most training tasks. 
The use of video recordings can Improve performance testing. There Is a 
requirement for additional research In this area. 
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PREFACE 



This report documents a comprehensive analysis of an experimental 
video system and guidance for use of that system. Research was accom- 
plished under Project 1121, Advanced Technology for Air Force Technical 
Training. Dr. Marty R. Rockway was the Project Scientist and Mr. 
Arnold L. Hanson was the Task Scientist. 

Research contained In this technical report was conducted under 
the provisions of Contract No. F41 609-72 -C-0021 with URS/Matrix, 7245 
Arlington Blvd., Falls Church, Virginia 22042, for which John F. Hayes 
was the Senior Staff Scientist, and Edgar L. Shrlver was the Consultant. 

The authors which to acknowledge Mr. William E. Hudson, Training 
Research Applications Branch, Sheppard Air Force Base, Texas, for making 
the scheduling possible, and the many other persons there who partici- 
pated, partlculary MSgt J. H. Phalan and SSgt Masters. 
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SECTION 1.0 FLAN AND OBJECTIVES 

Research performed under Contract F41609-72-0021, ^^Development and 
Evaluation of Video Systeas for Performance Testing and Student Monl-* 
torlng*^ was to explore the potential of video systems. URS/Katrlx 
provided an experimental video system. Initial experience In Its use, 
and guidance docments to which USAF personnel can refer In using that 
system to extend and expand the capabilities of USAF Instructors In 
student monitoring and performance testing. 

To accomplish this Investigation, a four-phase project was under- 
taken. Phase I was directed at selecting training and «.estlng appllca-^ 
tlons to serve as vehicles for the research, and designing a prototype 
video observation system. Phase II was devoted to acquiring tha video 
system and to developing a rationale to guide Its Implementation. Phase 
III was an experimental appllcat:lon of the system to USAF training, and 
Phase IV developed guidance documents which describe how such systems 
can be designed and employed. 4 

This report describes work performed between 15 Harch 1972, and 
28 September 1973. 

1.1 HYPOTHESES ^ 

Video systems have most typically been uised as Instructional tools 
to present Information to the student. They provide a medium of storage 
for Instructional materials, and the role of the Instructor Is to call 
those materials up for presentation at the appropriate time. This pro- 
ject, however, was designed to examine how such systems can be employed 
to expand Instructor capabilities by displaying Information about the 
student to the Instructor; In effect, to "turn the camera around," so 
that the Instructor can more effectively observe while the students 
perform. 
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The general hypothesis assumed by this project was that video 
observation can be enployed to esqpand an Instructor's capability, per* 
ttittlng him either to monitor the performance of more students, to 
monitor the same nuaber more effectively, or to adopt more effective 
testing and training techniques such as performance testing and guided 
practical work. 

Several underlying assunptlons were contained in that hypothesis: 
One was that the most effective method of training, and of evaluating 
personnel being trained for technical Jobs, is through the e^loyment 
of practical work and criterion-referenced performance testing. Another 
was that a main deterrent to the use of such techniques is the amount 
of time, equipment, and individual attention required to eiqiloy them. 

It was further recognized that the USAF technical training system 
provides an ideal laboratory in which to develop video techniques for 
performance testing and student monitoring, and it was assumed that Air 
Force training would benefit from such a development. 

1.2 OBJgCTIVES 

The Air Force technical training system is a labor intensive enter- 
prise. Because of the heavy emphasis on **hands-on" experience, there is 
need for Instructor personnel to continuously observe and guide students 
during both training and testing. The demands placed upon the Instructor 
in performing these functions are further aggravated (a) in situations 
where students are spatially dispersed and (b) in individualized training 
systems where students are progressing at their oim pace and where test- 
ing may occur on an unscheduled basis. 

The overall objective of this effort was to develop, ^'.valuate, and 
assess the costs and benefits associated with a video system, one which 
could extend the instructor's capability to conduct performance testing 
and ^student monitoring in an Air Force technical training environment. 
Accomplishment of that overall objective Involved the following subor- 
dinate objectives: 

T 
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To evaluate commercially available video components and to prepare 
a specification for a low cost video syntem (of commercial compon-> 
ents) capable of accomplishing the specified tasks. 

To procure and operate the designed system in a technical training 
environment • 

To test a. qtiantified, vidao recorded, performance test scoring 
system for use in technical training. 

To develop sample sets of video recordings, and procedures for 
their iise in training and standardizing the grading/rating practices 
of performance test scorers. 

To develop a two-way cosoiunications system to permit student-* 
instructor interaction. 

To develop a user-oriented handbook to be used in selecting and 
using video systems in testing and student monitoring. 



1.3 ASSUMED REQUIREMENTS 

Certain assumptions were made concerning the nature of the USAF 
training system and the video opportunities it might generate: 

Since the Air Force technical training system is largely perfor- 
mance oriented, performance testing is an essential tool for accurately 
evaluating student achievement in that system. The basic measurement 
policy is to assess the attainment of training objectives which require 
student performance, by using performance test items to the extent 
practical. One of the key constraints associated with performance test- 
ing, however. Is the limited availability of qualified instructors to 
monitor and score the tests. 

With the advent of individualized instruction and individual pacing, 
the requirement for testing on an unscheduled basis will create an even 
greater problem. Techniques, hardware sets, and testing and monitoring 
systems are required which can enable the Air Force to minimize' this 
difficulty, and to fully exploit the advantages of individualizing 
instruction without an unacceptable increase in the number of instructors. 

An additional problem in performance testing is lack of objectivity 
in scoring the tests, especially vAien the test involves a process as 
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opposed to a product s This is duet in part, to the frequent absence 
of performance standards for the process, and also to the fact that the 
tester is required to exercise Judgements based on brief and often single 
observations. 

Video tape recordings can be used, In effect, to change the process 
to a product. Recordings of acceptable and unacceptable performance can 
be repeated to create reproducible standards. The use of recordings can 
permit time compression, time expansion, or a freezing of time which 
will allow a more systematic look at those aspects which are relevant 
to acceptable performance. It can also make available a coiqilete record 
of a student's behavior, for evaluation at a later time. If on-line 
scoring Is not feasible. 

Students In an Individualized mode proceed at different rates, 
frequently work In different locations, and tend to become dispersed over 
both time and distance. Despite that dispersion, the requirement to 
monitor and evaluate students and their progress still exists, and aggra- 
vates an already labor short situation. Unless some system for extending 
the capabilities of the available Instructors Is devised, a requirement 
for additional Instructors Is created. 

Video technology appears to be a promising approach for extending 
the Instructor's ability to monitor and direct students. It permits 
observations from remote locations, the monitoring of Individuals or 
groups, the use of a variety of perspectives (some not possible with the 
unaided eye) , and the collecting of recordings to be viewed at a more 
convenient time and/or place. Finally, student review of recordings can 
provide a unique kind of feedback. In general, the use of video moni- 
toring appears promising as a means to Increase both instructor and 
instructional efficiency. 

1.4 PROJECT PLAN 



To explore the potential of a video system in performance testing 
and student monitoring, URS/Matrix proposed a four phase plan: 
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Phase I was a design study, and consisted of a study of the testing 
actually being conducted in USAF technical training. Tests were to be 
studied and evaluated, the testing environment analyzed, and a best-<flt 
system of video hardware specified. 

Phase II was to Include the acquisition of an actual hardware system 
using off-the-shelf commercial components, and the development of metric 
techniques to be applied In Phase III. 

Phase III was to consist of a field test In selected technical 
training environments. The video monitoring and recording system was 
to be evaluated, alternative strategies of eiq>loyment developed, sasqple 
Job-performance tapes recorded, and an assessment made of costs, person- 
nel reqtilrements , and the feasibility of applying the system. Recommen- 
dations were to be made for future research and developments 

Phase IV was to consist of the development of user handbooks. Those 
handbooks have been prepared ^d delivered to the Air Force, separately 
from this report. 
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SECTION 2.0 STUDY OF USAF PRACTICE 

In order to recommend an optimi?! configurmtlon for the proposed 
video sy8tem> it was necessary to acquire data concerning the real test- 
ing and training environment in which that system would be used. There- 
fore URS/Matrix personnel visited Air Force technical schools, and 
studied current testing practices in a series of , representative technical 
training courses. Support to this effort was provided by the Technical 
Training School at Sheppard Air Force Base, Texas. Personnel in each 
Department of the School, upon being briefed as to what was desired, 
nominated specific candidate courses in their department for review and 
study by URS/Matrix project staff. 

Four courses, with four specific performance measurement points were 
selected for continued study, of which three were ultimately iised in the 
field tests (Sections 7.0, 8.0, and 9.0 of this report). 

2.1 METHODS EMPLOYED 

An analysis of the observation and testing requirements associated 
with the selected courses was subsequently undertaken, using the follow- 
ing techniques: 

Review of the performance testing materials utilized. 
Observation and filming of performance testing activity. 
Analysis of environmental factors. 
Laboratory investigation. 

The first technique consisted of reviewing performance testing mate- 
rials currently utilized in the four selected areas, to establish the 
observational requirements inherent in current procedures, and the types 
of performance being tested. Test scoring schemes were examined, as well 
as the relationship of performance test items to course objectives. The 
purposes of this review were to determine which student activities were 
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useful to observe via video techniques , the amount of student observa- 
tion that would be reqtilred, the feasibility of objectively scoring such 
activities 9 and the relevance of any performance test to the training 
objectives stated by the plans of Instruction. These last two purposes 
supported a psychometric evaluation of the testing techniques being 
employed. Course materials were reviewed first; on completion of this 
review the testing sitxiations were observed first-hand. 

Study of testing method Included interviewing instructor and super- 
visory personnel concerning the mechanics of each testing procedure, 
and the flJjning of sample situations for later analysis. Of particular 
Importance were considerations such as student flow (frequency of test- 
ingy number of students, testing areas, etc.)* Instructor duties and 
assignments, and physical and environmental conditions. Interviews with 
staff members pxovided detailed Information on administration procedures, 
potential and actual problem areas, the presumed value of a CCTV system 
to the testing situation, and system constraints imposed by school 
requirements . 

Films taken of sample test performance were used to provide initial 
estimates of technical problems to be encotmtered. Preliminary estimates 
were obtaln'id of required camera distances and angles, lighting, occlusion 
problems, and the clarity of areas to be viewed. Film provided a conven- 
ient and inexpensive medium for permitting more people to observe each 
testing situation without actually traveling to the site. Other matters 
that were observed included light levels, power sources, potential camera 
mounts, personnel traffic patterns, instructor/student communication 
requirements, sizes of the visual fields, and temperature /humidity con- 
ditions. 

A studio/laboratory of the URS/Matrix facility was employed to study 
camera and recording problems in greater detail. Among operations 
explored in this environment were visual access via mirrors, the effec- 
tiveness of various kinds of mirrors, effects of the resolutions 
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of various cmras on visual monitoring, effects of lighting variations, 
and capabilities of various lenses. 



2«2 ANALYSES OF PERFORHANCE TESTING AREAS 

Four courses were studied. They were the Jet Aircraft Mechanic 
'Basic Course, the Civil Engineer Power Linemen Course, the Conmuftlcation 
Equipment Repairman (teletype) Course, and the Technical Instructor 
Course. 

2.2.1 Jet Aircraft Mechanic Testing The department concerned 
here was the only one which conducted performance testing as a function 
separate from training; a special section ran the testing program, and 
had a hangar area, aircraft, and personnel assigned to it for that sole 
purpose. The Jet Aircraft Mechanic Course was a high production course, 
receiving several hundred students each month. The course contained 
five "blocks" of instruction, and sttidents were sent to the performance 
testing area at the end of each block. There they were put through a 
series of performance tests relating to the block of instruction which 
they had just completed. This testing was scheduled for six hours for 
each class, with class sizes ranging from eight to sixteen men. 

The area selected for our investigation was the Block V test area. 
This consisted physically of an aircraft and three adjacent testing 
stations, plus a classroom Just off the hangar area. A diagram of this 
area is included in Section 7.0 (Figure 12). The testing program includ- 
ed both written and Job performance tests. 

Typical Block V performance tests involved removing and replacing 
a flight control system conqponent located on the underside of a wing, 
removing and replacing a wheel, checkout of the hydraulic system, check- 
out of the lighting system, inspection of the flight control system, 
checking inflation of tires, utilization of technical manuals to find 
Information, and checkout and inspection of a battery. Many of the 
performance tests required that the student record his findings In 
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written form for evaluation, to reduce the workload on tlie test admln*- 
Istrators. There were a total of 15 possible performance test Items, 
of which each student was given eight. 

Two test administration procedures were \ised. In the first proce- 
dure, students were given all the written test first, and then were 
scheduled through the performance tests on a seqiientlally assigned 
basis, allowing twenty minutes for each test Item. During performance 
testing, there were from 8 to 16 students performing tests simultan- 
eously, on different parts of the aircraft and at adjacent test mockups. 
Half of the performance Items required that a test administrator check 
the student's work. Indicating whether It was satisfactory or unsatis- 
factory. For the balance of the test Items, the students recorded the 
results of their Inspection or checkout findings on an acetate-covered 
form, using a grease pencil. Two separate sets of Instructions and 
answer forms were used, so that the test administrators cotild grade one 
set, erase It, and assemble It for the third test cycle, while the 
students were taking the second test with the other set. This procedure 
required two test administrators to grade and record results during a 
twenty minute testing period, and a third to grade students taking those 
tests which required an on-the-spo*: check* 

A second test administration procedure was used as much as possible, 
since It liiq)osed less time and pressure on test administrators, but It 
could be used only when the class was small. Using this method, the 
students programed themselves through both the written and performance 
tests on an as-ready basis. All grading of tests was done at the end 
of the testing session* Two test administrators were then required, and 
they checked each student's work when he Indicated that he was ready. 

Testing techniques were set up to eliminate any requirement to con- 
tinuously observe any Individual test performance. Grading was done 
either by observing end-products, or by evaluating recorded answers* 
Performance tests were limited to tasks or sub-tasks that could be per- 
formed within a twenty minute time span. The technical documentation 
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available for uae waa extremely detailed. Virtually all teata were 
part-taaka; that la, they required the attident to pexfern a limited 
atibtaak of a larger maintenance Job. During performance teating, a stu- 
dent frequently aaked queations to obtain clarification or information 
regarding the taak; theae were answered or not, baaed upon the teat 
admlniatrator's Judgement. 

From UKS/Matrix analyaes, aeveral teats were identified for which 
full-time observation might be preferable to end-product observation. 

2.2.2 Power Lineman Training Area A prime selection criterion 
for power linemen is that they posseas the physical coordination (and 
Other characteristics) necessary to learn to climb and operate from the 
top of 30-45 foot poles. To avoid inveatlng training on individuals 
who were .either incapable or unwilling to operate under such conditions, 
a pre-test was given to all entering students. It consisted of having 
them dinb a 45 foot pole that was equipped with climbing ateps, and 
another pole using leg spikes. The student's confidence and coordination 
waa Judged by an inatructor, who observed them from the ground as they 
performed those two tasks. 

This test offered an interesting analogy to the selection of para- 
troopers during World War II. At that time the first test of a para- 
trooper waa to have him Jump from a 34 foot mock tower. If he refuaed, 
or showed excessive fear, he was immediately washed out of training. In 
a special study of 1,300 men, thirty seven men refused to Juiiq>, but were 
allowed to continue the training anyway. Eighty-four percent (or 31 men) 
of this group of thirty-seven failed in subsequent training, in contrast 
to only 19 percent who failed in the remainder of the group. ^ 

At Sheppard AFB the pole-climbing pretests were conducted by instruc- 
tors on a rotating assignment basis. The NCOTC of the training section 



^ The American Soldier, Volume II (pg. 216). Princeton University Press, 
1949. 
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concerned had expressed Interest in finding some mechanism vhich would 
permit him to personally evaluate a larger nunber of students, and fur- 
ther to critique his instructors on their evaluations. The critical 
factors to be observed during these evaluations were facial expression, 
arm-leg coordination, speed of ascent, and the ability to manipulate 
spikes. It was expected, of course, that untrained students would be 
awkward, especially in setting and removing the leg spikes. This was 
not of concern as long as "trainability" was evident. 

Potential advantages of having such performances video-taped were 
identified as including the possibility that they could be reviewed by 
more than one instructor, that they could serve as a means of showing 
criterion performance examples to new instructors, and that they could 
serve as a means for critiquing student performance later in training. 

The pre-testing area was located immediately behind the Civil 
Engineering Department's classroom and office facilities, and is diagram- 
med in Section 8.0 (Figure 17). Students were received in groups of 
8-16 every three weeks, and testing occurred on Monday mornings. After 
the pre-test, each student was interviewed to confirm that he was willing 
to participate in the training and had no reservations about becoming a 
power lineman. Based upon the results of that interview and of the pre- 
test, an imiediate individual decision was made as to whether to permit 
each student to begin formal training.* Either the pre-test or the inter- 
view could be the basis for eliminating students at this point. 

Normally there were two instructors assigned to conduct the pre-test. 
The test area consisted of one 45-^foot pole equipped with climbing steps, 
and two shorter (30 foot) poles for testing spike climbing capability. 
Testing required approximately 5 minutes per student; approximately 
90 minutes was required to test a full group of 16. The Departmental 
officers were approximately 500 feet from the test area. 

Video cameras could be mounted at any desired distance from the 
target area. A major consideration, of course, was the ability oi 
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cm^TMB to withstand a reasonable range of weather variation (wind, duat, 
rain, cold, heat, etcO* Due to the relatively long Interval between 
testing periods, and the low student flow rate, it wpuld be desirable 
that the cameras be convenient to mount and dismount as needed. 

Instructor evaluations of the student's potential capability and 
willingness to climb were entirely subjective, and were based upon obser- 
vations and experience which, of course, varied from instructor to 
instructor. Any time such evaluations are required, it is desirable to 
develop common standards to the extent possible. 

Another phase of performance testing that was conducted in connec«- 
tion with the power lineman course took place at the end of each block 
of training. This testing was conducted in a different training area, 
consisting of a series of poles that were located approximately one-half 
mile from the classroom facility. Students had to perform such tasks 
as removing and replacing cross-arms, repairing insulators, and splicing 
cables. Typically, the instructor would sit on top of the pole and 
observe the student's performance. If there was power on the lines, the 
instructor would observe from a bucket truck, close enough to prevent 
accidents . 

In evaluating performance on tasks conducted in this area, the 
instructor had a checklist that covered all aspects of the student's 
performance, from work preparation (putting on protective clothing) 
through mounting the pole, making the specified repair, following pre- 
scribed safety practices, to paper work related to the Job. This meant 
that the instructor had to observe total task performance, treating each 
element as it was encountered. A majority of these tasks were two-man 
tasks; only one man, however, was evaluated at a time. The second man 
was essentially a helper, who followed the directions of the individual 
being tested. 

These performance tests were based on much more objective grading 
criteria than those used for the climbing pretest. It was usually 
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possible to make, a clear-cut determination as to whether a man had 
satisfactorily performed each task of the test. The only area of sub-- 
jectivity was the Judgement required by the instructor when the man was 
performing a task that required a helper* 

There were a number of characteristics of this testing operation 
that affected video observation. For example, the exact site of testing 
changed periodically, due to poles wearing out, conflicts with other 
class operations, and class sizes. This meant that any permanently 
mounted video cameras would occasionally have to be removed. There 
was no building, or other suitable enclosure for equipment, closer than 
the classroom facility; thus a trailer or other small portable structure 
would presumably have to be provided. When students were performing 
with power on the lines, the instructor had to be able to stop them 
immediately if they were getting into trouble. In those areas where 
power was on the lines, it was essential that the instructor be in the 
immediate proximity of the students anyway, and remote video monitoring 
was not necessary. 

2.2.3 Teletype Repairman Testing Upon completion of a three-week 
block of instruction in teletype repair, students in the Communications 
and Relay Center Equipment Repairman Training Course were given a series 
of performance tests. In these tests, the instructors placed one of a 
series of malfunctions into a teletype, and then had the students locate, 
identify and repair the defect. Testing occurred in the same room in 
which training had been conducted. A standard classroom contained six 
pairs of teletype printers, back-to-back, located in the center of the 
room. Between each pair of printers was a work table %rith a tool rack. 
The room was well-lighted and had ample power sources. 

Typical repair problems which were inserted into the equipment con- 
sisted of a combination of mechanical and electrical malfunctions, and 
were a subset of those that students had encountered during training. 
The average time required for students to locate and correct these prob- 
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lems ranged from five to fifteen minutes. After the lim true tor put the 
problema Into the equipment, the students came Into the room and turned 
on the machines to determine what the S7iq)tom8 were. Working from the 
machine, his technical data, and what he had learned, each student diag- 
nosed a suspected fault. When he thought he had correctly Identified 
tf^e problem, he wrote It down en a slip of paper and showed It to the 
test administrator, who told him either to go ahead and make the Indica- 
ted repair, or that the defect he had Indicated was Incorrect. In the 
latter case the student retfimed to the machine and continued trying to 
Identify the fault, tlxe Instructor gave only general Information about 
his performance to the student If he was Incorrect* He might tell him 
that he was close, or In the right general area, or that he was way off 
track. The amount and type of Information given to the student seemed 
to vary a great deal during the time that these tests were being observed. 
Once the Instructor had told the student to repair the machine, no fur- 
ther check was made on his work. Apparently It was assumed that once 
the student has correctly Identified the problem, he could properly 
complete the repairs. During the time that this testing was observed 
no one failed a test. The overall testing environment seemed to-^resenble 
that of a controlled practice session, with assistance and guidance given 
as required. 

The area within the teletype machine In which students worked Was 
very confining. There was no need for continuous student observation, 
based on the way testing was structured, nor were there any critical 
safety demands. Traffic within the room was heavy, due to students 
leaving their work areas to show the Instructor their %n:ltten problem 
diagnoses. Between tests, all students left the room while new problems 
were placed Into the machines. 

Two Instructors were used during testing. One moved about the room 
answering questions, while the other remained In one place and Informed 
the students whether or not each had fotmd the problem. 
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2. 2 A Instriictor Training One of the technical training depart- 
ments at Sheppard AFB had the additional duty of operating the Instructor 
Training Department. Kew Instructor personnel assigned to the Technical 
School were sent to this department for tr^nlng. In the course of this 
preparation, television was already being employed to tape student 
Instructors* presentation In front of their classmates. These tapes 
were then used for student critique. In the latter phases of the pro- 
gram, Instructors were assigned to the technical department of their 
specialty, to '^practice teach" In those departments. Student Instructors 
presented five such classes. During these presentations, the Instructors 
were evaluated by personnel from both the technical department concerned 
and the Instructor Training Department. 

Discussions with personnel In the Instructor Training Department 
Indicated that at the time of URS /Matrix study, this department could 
seldom free personnel long enough to adequately observe and critique the 
sessions. They relyed on the technical departments in which the students 
did their practice teaching to evaluate that performance. Instructor 
Training Department personnel observed the students* performance only 
when they were ** Ins true ting** their fellow classmates; this was an arti- 
ficial situation. In which everyone was cooperative. 

A video recording capability could be useftxlly en^loyed during 
applied practice teaching to provide a semi-permanent record of student 
teaching performance, which could then be critiqued at a more convenient 
time and place by the Instructor Training Department. Additional bene- 
fits that a CCTV system might offer Included allowing review by more than 
one evaluator, providing feedback and critique to the instructor, and 
providing a means of standardizing evaluation criteria. 

The practice teaching sessions generally occurred in one of several 
specific classrooms, and consisted of conventional lecture presentations 
rather than labs or practical work sessions. The environment was a 
standard classroom, with the instructor giving a **standup** presentation. 
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While the URS/Matrlx team made no observations of thetfe practice 
teaching sessions at Sheppard, an opportunity did arise to observe the 
video taping of a live classroom session In a different technical envir- 
onment* This setting was a Coast Guard class In electronics maintenance* 
In this Instance, a two-camera system was e]q)loyed* A diagram of the 
classroom setup for this purpose Is shown (as It was later used at 
Sheppard AFB) In Section 9*0 (Figure 18). 

2*2*5 Comparison of Testing Environments Table 1 compares the 
four performance testing areas studied, across several dimensions, as 
they Impact video system design* 

The main problem to be encountered In the teletype environment would 
be that of Installation* Space Is limited, so suspended cameras would 
be reqxilred* These cannot be easily Installed on a temporary basis* 
It was determined that this application would yield Information com- 
parable to that already available in the Jet aircraft environment* It 
was decided, therefore, not to Include teletype training In subsequent 
Investigations* 

The Jet aircraft mechanic testing area contained both process- 
oriented and product-oriented tests* In addition, It presented several 
access and traffic flow problems, and cottld benefit from a semi-remote 
observation system* The Instructor could be located In a central loca- 
tion with video monitors, and follow the action of several subjects 
simultaneously, hopefully giving all more attention than previously, with 
less movement about the testing area* This could provide the opportunity 
to examine span of control problems, as well as those Involving the 
attainability of sufficient resolution and detail to permit evaluation* 

The power lineman pre-test course provided an opportunity to examine 
several technical problems not present in other courses* The video sys- 
tem would have to be able to **track" a student over a relatively wide 
distance, with a remote- control camera which would be mounted out of 
doors* The testing evaluation criteria were quite subjective, and the 
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focus of the study would be to determine whether ■tandsrdizstlon of 
evaluations could be facilitated by use of performance ssmple tapes. 

Instructor training practice teaching was selected on the basis of 
its content, rather than technical considerations. The technical prob' 
lem was to capture an appropriate mix of views of Instructor and stu- 
dents, rather than extreme detail. The Important evaluation would be 
whether a self-operated video system could provide a useful record of 
instructor performance in a live situation, and permit off 'line evalua- 
tion of instructor performance. « 

2.3 CONCLUSIONS AND IMPLICATIONS FOR VIDEO SYSTEM SPECIFICATION 

Review of USAF performance testing (described above) led to identi- 
fication of typical testing patterns and environi^nts, and preliminary 
identification of three testing tasks for use in test application of a 
video system. Further analysis of these tasks was undertaken to identify 
the characteristics required of a preferred' video system. Not surpri- 
singly, the final system configuration recommended was one which conso- 
lidated the several components, subsystems, and technical characteristics 
required by different tasks. Provision for interconnecting subsystems 
in a flexible manner would make it possible for such a system to meet a 
wide variety of potential future requirements for video monitoring and 
recording in human performance measurement. 

The next subsection (3.0) contains the specification of a video 
system which satisfactorily meets all of these requirements and situations. 

2.3.1 Nature of Performance Tests Performance tests can be classi- 
fied as either process-oriented or product-oriented. Those which are 
process-oriented require observation and evaluation on either a contin- 
uous or Intermittent basis; they demand more Instructor attention and 
thus Impose a heavier load on the Instructor than product-oriented tests. 
This implies that any video system designed to cover process-oriented 
tests must provide both the mechanisms and the opportunity for the 



instructor to observe the specified processes. It nay reqtiire a system 
able to follow the performance activity over an area beyond the range 
of a single fixed camera, necessitating the use of multiple or remotely 
operated cameras. Process*-*oriented tests tend also to limit the number 
of simultaneous observations that can be made by a single instructor. 

Product-*oriented tests are those that restxlt in the production of 
a defined end product, which can be evaliiated by inspection upon comple«- 
tion of the task. Such products may take the form of an identified 
malfunctioning part (i.e., teletype repair), a completed connection or 
adjustment (i.e., aircraft maintenance repair)*, or even the answer to a 
written question. Product based tests reduce instructor evalxiation and 
administrative loads, and are the most widely used form of performance 
tests. If there are a number of dispersed stations at ^ich such testfi 
are being taken, and if the instructor is required to continually move 
among them (as he does in the Jet aircraft maintenance test) , then video 
observation may offer a means of iiiq;>roving testing efficiency. 

The relative degree of task grossness impacts the selection of a 
video system by establishing the size of the field which must be viewed. 
Fine tasks, such as those observed in the teletype repair tests, may 
require a viewing field of only a few square inches. As the distance 
of the activity from the camera increases, lens requirements change. 
More gross tasks, such as pole clinbing, present much larger target areas, 
and tend to relax camera distance/lens requirements. The most stringent 
requirements are imposed when a performance test contains both gross and 
fine tasks. To monitor such tasks requires either multiple cameras or 
expensive lenses. 

Also related to task discrimination requirements is the number of 
students normally undergoing performance testing simultaneously. When 
performance testing is normally a group activity, as opposed to a single 
student activity such as pole climbing, and when more than one siibject it\ 
t'eing graded at a time, the size of video field as well as target resolu- 
tion are affected. 
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The student response xDode was observed to vary considerably from 
one performance testing sltxiation to another. Students were required 
to inspect, checkout 9 manipulate , answer orally or answer in writing^ 
based upon the construction of the performance test. The nature of each 
response will establish the need for and/or feasibility of video per- 
formance observation. If the student must perform a vlsiial task, it is 
imperative that the instructor either see the same view as the student, 
or else know exactly what that view is. He must further be able to 
verify that the student is performing the operation correctly. In the 
case of checkout 9 or other manipxilative tasks of a sequential nature, 
the CCTV system must provide sufficient range and resolution that all 
operations can be followed, implying that wide-angle lenses or remotely- 
positionable cameras may be required. If verbal communication is requir- 
ed as a part of testing, an atidio communication system may be necessary. 
"Communication^* itself, however, can be achieved in different ways and 
further analysis was required to determine whether a single go/no-go 
system (e.g., lights, buzzers, etc.) would suffice in certitin testing 
situations, or whether one or two-n^ay voice communication would be 
required. 

Written student responses ordinarily are not suited to video moni- 
toring. When used in conjunction with performance testing, they repre- 
sent one alternative means of solving some of the same observation 
problems which video systems address. When examining a performance 
testing situation for potential video applications, video cannot be 
recommended where a written response is feasible and sufficient. An 
example was seen in the Jet mechanic testing area, where the current 
requirement was for the student to make a written response upon comple- 
tion of a performance task such as an inspection or checkout. The on- 
going testing operation continued to use his standard written response, 
but the video system was used to examine the content of his performance, 
to see what types of evaluation would be meaningful and feasible under 
video observation conditions, what advantages they might offer, and 
whether the written response was in fact sufficient. 

25 



BtSI COW MWABLE 



The instructor evaluation mode is directly determined by the 
student response mode. The Instructor may visually observe the student 
process or product , check It by touch (e.g., operation , checking for 
tightness) 9 listen to a student explain his performance^ (e.g., teletype 
repair) 9 or evaluate a written response. Visual requirements determine 
such CCTV system parameters as color , resolution , lighting, and special 
effects (e.g.f slow motion, stop action), from which video equipment 
requirements are derived. If the instructor must physically touch the 
performance product, a video system will be of no use; in such cases, 
if video provides other advantages, then consideration may be given to 
altering both the performance and evaluation modes. 

2.3.2 Environmental Characteristics of the Testing Area The 
physical location of the performance testing area and of the video moni* 
torlng area affects video system design in several ways. Location 
establishes the limits of accessibility to the target area, which con- 
trols camera angle and method of viewing. In combination with the size 
of the performance test object or work area, it dictates lens require- 
ments. Location of the target area vis-a-vis obstacles and traffic 
constrains vldej camera location. Availability of power is a constant 
consideration; there are seldom enough readily available power sources. 
In the extreme case, this can lead to the need for a battery-powered 
system, or the Installation of a new power supply. The relative dis- 
persion of video target areas within the performance locale directly 
determines the number 6f cameras, and/or whether cameras must be fixed 
or adjustable. 

The prevailing external environment in the testing area must also 
be considered in system design. Ambient conditions of noise, illximlna- 
tlon, temperature, and humidity must be evaluated for their impact. 
Noise levels affect the kind of audio pick-ups used, since their sensi- 
tivity must be such as to pick up target sounds without tmdue masking 
noises. Illumination is critical to the sensitivity of the vidicon 
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selected, as well as to camera position. Vidicons have specified illiim- 
ination requirements, and must be matched to the environment; also, 
vidicen tubes develop %um spots" if exposed to strong incandescent 
light. 

Temperature and humidity levels must be checked for extremes. Most 
indoor locations present no problems, but outside locations can require 
the weatherproof ing of exposed conqponents. Dirt is another consideration, 
especially with recording equipment. Recording heads and tapes require 
relatively clean environments. 

There are human factors aspects of the testing situation that affect 
system design. The traffic pattern in the area is a major considera- 
tion, since the objective is to be as unobtrusive as possible, and to 
impose no undue constraints on personnel in the system. 

A particular consideration is that of safety. Many performance 
testing situations are in hazardous environments (e.g., high voltage, 
moving parts, dangerous liquids), and are set up for close instructor 
supervision. Remote video observation can remove the Instructor or 
supervisor from the immediate locale, which may not be tolerable. If 
safety considerations are important, then the video monitoring system 
must provide the necessary safeguards. 

2.3.3 Instructor Loading Factors A major objective of video 
monitoring is to expand or augment the instructor's capability; another 
is to provide him with access to events that were not previously access-' 
Ible. In designing a CCTV system to achieve one or both of these objec* 
tives, one must insure that so many system tasks are not imposed upon 
the instructor as to reduce his effectiveness. Every additional demand 
made upon him (e.g., camera positioning, recorder operation, tape load-* 
ing, etc.), must yield a gain sufficient to provide a net advantage. 

2.3.4 Criterion Tape Production To make maximxim use of a video 
observation system for performance evaluation and training, instructors , 
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need to have available standards of correct performance against which 
to judge student performance* The proposed video system must therefore 
have the necessary equipment to produce such materials* 

Criterion performance tapes will record and display controlled- 
productlon performances , In which a subject demonstrates the correct 
way of performing a task, and will possibly point out common errors for 
which the Instructor should be on the alert* The use of such standards 
can reduce the variability of scoring practice among Instructors, and 
Insure that evaluations focus on critical rather than trivial or 
Irrelevant aspects of performance* 

2*3*5 Implementation Hypothesis Based upon analysis of the 
selected application areas, a more specific evaluation hypothesis was 
developed concerning how video observation techniques can be employed* 

It was hypothesized that a video monitoring system can be provided 
that permits an Instructor to remotely observe, critique, and correct 
the performance of physically dispersed students on practical exercises 
or performance tests, either in real-time or by recording such events 
for later analysis* 

Such a system can further permit remote observation and critique of 
the performance of students operating in outside areas, and the record-- 
Ing of such events* 

The system can make it possible for an instructor to record his own 
performance, in presenting instruction to actual classes, for subsequent 
review and critique* 

The system can make possible the acquisition of video tapes of 
various levels of test performance, to be used to investigate methods of 
quantifying such performances* The resultant quantified performances 
could be used to examine ways of evaluating and improving reliability 
among raters of job performance tests* 
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These objectives can be accomplished .without significant Inter-- 
ference with the Instructor's primary duties, or Increases In operational 
personnel* 

2«3«6 Hardware Requirements The minimum system capabilities 
which would be required to monitor and record student performance In 
each application area were Identified, and expressed In terms of video 
hardware components. They were, listed by area: 

In the Jet Aircraft Mechanic Test: 

Four video cameras, with sufficient lens flexibility that 
shots could be achieved at distances from five to twenty feet« 

At least one monitor for each of the four cameras, in order 
to study span of control* 

One camera equipped for remote lens and remote pan/ tilt 
operation* 

A set of high quality mirrors, so that visual access to 
cramped working quarters can be secured. 

An auxiliary lighting system for individual spot-lllumlnatlon. 
No overall illumination system will be required* 

A minimum of two video recorders that provide both time com- 
pression and expansion* 

T^-way voice communication between the Instructor and the 
student so that questions can be asked and instructions given* 

Three cameras equipped with manual zoom lenses, to evaluate 
different camera configurations* 

A split image capability, to evaluate the information yield 
of multiple images on a single screen* 

In the Power Lineman Fre-test: 

Two video cameras, one remotely operable and capable of tracks 
ing a student climbing to the top of a 45 foot pole within 
30 seconds, from a distance of 50 feet* The second camera can 
be positioned manually* 

A zoom lens capable of remote zoom from a field size of 7 feet 
in height to one of 2*0 feet in height, at a distance of 50 
feet, to view arm/ leg coordination and facial expression* 
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Camera installation weatherproofed against rain. dust, heat 
and cold (20-110°F.). 

A minimum of two video recorders, to provide both time com- 
pression and expansion of recorded seqiiences. 

A camera vidicon capable of operating in bright sunlight (not 
directly into the sun). 

In the Instructor Training Test: 

A minimum of two cameras to provide a full view of the 
instructor and of the students throughout the presenution. 

Synchronized playback of the two views, either through split- 
screen or other simultaneous viewing device. 

A full and coherent audio pickup for the students and the 
instructor. 

A camera to provide full coverage of a 20 x 30 foot classroom 
without operators. 

Recording and other gear located in an adjacent area to reduce 
distraction. 

Vidicon to operate in normal classroom lighting without 
augmentation. 

Two video recorders, one of which will provide a time com- 
pression capability. 
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SECTION 3.0 SPECIFICATION OF HARDWARE 

Based on the study of USAF testing practice just described (Section 
2.0), a system hardware configuration was developed, capable of meeting 
specific video requirements of the three testing situations selected 
for detailed study, but with an additional potential for flexible appli- 
cation to job performance measurement elsewhere in the USAF training 
environment. In specifying hardware, URS /Matrix first made specific 
video technical decisions, in terms of nunbers of channels, capabilities 
and limits of the system at each signal processing point, and of system 
constraints Imposed by human engineering (operator) limits . When these 
decisions had been made and confirmed in terms of cost/benefit relations, 
they in effect specified a basic system within the state of the art 
(1972-1973). It remained to identify specific conmercially available 
components, to combine them compatibly in an engineered system, and to 
build the system. 

3.1 RATIONALE FOR SYSTEM SPECIFICATION 

Specifications laid down by the Air Force in the original procure- 
ment request were the point of departure in designing system hardware. 
Those specifications were that the system would be: 

Commercially available 

Low cost 

Mobile 

Cover a wide range of detail and field 
Easy to operate 

Provide for both recorded and "live" observation 

Provide slow, fast, regular, and stop speed capability on playback 

Provide for audio 2-way coomunlcation 

Be expandable to provide coverage of 12-15 students 
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3.1.1 Cameras A four camera system was at first recommended, 
based on a trade-off among factors of cost, coverage, and representa- 
tiveness. It was considered that four video channels were the most 
which an instructor - console operator could monitor and control. Later 
it was recognized that additional cameras add little to cost, and sub- 
stantially expand the range of the system. In particular, they are 
needed for situations in which several work sites exist, but may not all 
be active at any moment. The final recommended configuration included 
8 cameras of which only 4 were continuously monitored. 

An early decision, made on the basis of economic and technical con- 
siderations, was to rule out a color capability. As USAF practice was 
studied, this decision was checked several times to insure that color 
was not an absolute requirement in any situation being studied. This 
was confirmed sufficiently to uphold the original decision. 

Color video systems exceed the cost of black and white systems by 
at least a factor of two. In addition, the current state of the art is 
such that color equipment requires more careful alignment, lighting, and 
environmental control than black and white equipment. The application 
environments under consideration in this project represented fairly 
severe conditions, and the video system could not be permitted to impose 
limiting demands upon the testing environment. 

The selection of cameras was driven by lens requirements, costs, 
lighting, and the presence of certain other features of the system such 
as a special effects generator. Monochrome cameras for CCTV are virtually 
all equipped with vidicon tubes. These, as opposed to plumbicon or 
orthocon tubes, are inexpensive, reliable, and less complex to set up. 
They also produce less sensitive performance, but, unless color or 
"broadcast" quality is needed, are quite adequate. 

Vidicon tubes are available in 1 inch or 2/3 inch sizes. The 2/3 
inch tube is less expensive and gives slightly lower quality performance. 
The 2/3 inch tube, however, is not as flexible with respect to lens use. 



32 



BEST COPY AVAILABLE 



since there is a narrower range of lenses available for use with that 
ttibe. For this project, analysis showed that lens flexibility would 
be critical 9 since the system must serve a range of applications in 
which ranges y angles and levels of detail wotild vary greatly. In a 
fixed, single purpose system, where lens flexibility is not critical, 
the 2/3 inch tube might be the more desirable. For our purposes, how- 
ever, the 1 inch tube was required. 

Camera sensitivity was established at a 0.1 foot-candle minimum. 
This required high sensitivity cameras. In establishing sensitivity 
requirements, a trade-off was made of costs for sensitive cameras, 
against the possibility of providing supplemental lighting. Where 
possible, this latter course is often less expensive. But in applica- 
tion areas where lighting was of concern to this project, such as air- 
craft hangars, supplemental lighting had to be kept to a minimum to 
hold down clutter. 

Camera sensitivity is tied to another camera feature, that of 
synchronization. When multiple cameras are used, their signals must be 
synchronized— particularly when several monitors are to be observed (to 
prevent eye strain), when inputs are to be recorded, and when several 
cameras are to be fed through a special effects generator. In this 
project, all of these conditions were applicable. Some cameras provide 
random sync, which means there is no provision for imparting a common 
synchronization impulse. Others accept a predefined sync impulse (e.g., 
2:1, the most conmon), while still others accept a wide range of external 
synchronizing impulses. The latter, which we required, typically are 
''high sensitivity" cameras rated to operate in 0.1 foot-candle minimum 
illumination. In acquiring one capability, therefore, the other was 
provided. 

The synchronizing impulse is provided' by a separate device, a ''sync- 
generator'', which will be discussed shortly. Some brands of cameras come 
with a built-in sync generator^ Opting for this feature would have 
limited system packaging flexibility. 
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Further in regard to sensitivity » it was necessary to assure that 
selecting a high sensitivity camera for low light areas would not limit 
camera use in brightly illuminated areas. Therefore, an upper range of 
1500 foot-candles was required for operating outdoors in bright sunlight. 

Camera resolution was established at a minimum of 500 lines, based 
upon requirements for direct ("livcj") observation, costs, and effects 
on other system components. Detailed monitoring of mechanical repair 
operations will require as much resolution as can reasonably be built 
into the system, and the 300 line minimum level is considered a reason- 
able trade-off point. Cameras that yield 700 lines are considerably 
more expensive than those in the 500 line range. Dropping below this 
level would be unnecessary, and would degrade performance of the 
monitors. 

Vievfinders for the cameras were rejected as a requirement, since 
the camera will not be under continuous control. The only need for a 
vlewfinder is in camera set-up. This can be accoiiq)lished using one of 
the small monitors. 

Cameras were further specified as having a minimum signal-to-noise 
ratio of 40 db and being operable in either a random sync or external 
EIA standard sync mode. Video output was to be 1.4 volts peak-to-peak 
co]q)osite video 30 percent sync, with 75 ohm output impedance. All 
cameras were to accept standard C-mount lenses, and operate on 120 volts 
AC, 60 Hz power. Cameras were to weight less than 10 pounds; otherwise 
no size characteristics were critical. They were to operate in a temp- 
erature range from 20-llO^F. and humidity to 95 percent. The cameras 
required automatic sensitivity control to adjust for light changes 
averaging up to 1000:1. 

3.1.2 Lenses Lens selection was pivotal. The key to the high 
degree of flexibility required by this project was providing lenses 
which could adapt the cameras to a wide range of viewing conditions. 
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Two remotely controlled lenies were ipecifled^ for use on two 
remotely directed cameras. These were high powered zook lenses, suit- 
able to be used in the pole climbing task. They provided a full«screen 
view of a 3 square foot target area at fifty feet. TWo other zoom 
lenses (25-100 mm) provided flexibility for two additional cameras. 
Improved regular lenses were recommended for four other cameras, and a 
wide-angle optional lens was specified. 

3.1.3 Monitors The nuniber of monitors required is determined by 
the nxiober of cameras, and the nuiaber of "preview" and "program" moni- 
tors required. Basically, two designs are possible. In the first, one 
preview monitor and one program monitor are used. The program monitor 
is used to show what is being recorded at any given time. The preview 
monitor is switched from camera to camera in order to observe or select 
signals for possible recording. Only one camera output can be seen at 
a time in the preview monitor. 

In the second design, a preview monitor is provided for each camera, 
so that all outputs can be viewed continuously. A program monitcr is 
used in the same manner for each of the recorders (and special effects 
generators) to show what is being recorded. This second design was 
selected 9 based on requirements such as that of the jet aircraft mechanic 
application. Here there was a need to continuously monitor activity at 
a nuid>er of testing stations. Vlhile a single monitor would have been 
less expensive I it did not provide the required cap«%bility. 

Seven of the monitors were recommended to be 9 inch diagonal measure. 
This recommendation was based upon an analysis which indicated that the 
test administrator would be seated 2-3 feet from the screen. Optimum 
viewing distance (to take maximum advantage of the resolution capability) 
is five times the image height. A 9 inch diagonal screen is 5.4 inches 
high, so that optimum viewing distance was 26.6 inches. The program 
monitor for the recorders was likely to be located farther from the 
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instructor, so a 17 inch monitor was specified, which provided an audio 
playback capability. This size yields an optimum viewing distance of 
51 inches. 

A resolution level of 600 lines was established to insure that the 
monitors would repioduce all of the resolution available from the cameras 
during direct observation. 

Further specifications required that monitors should have a band- 
width of 9 Mhz, a minimum resolution of 600 lines at the center, and 
operate on 120 volts AC 60 Hz power. No audio capability or RF input 
was required on the 9 inch monitors; however, the 17 inch monitor was to 
have an audio amplifier and speaker, and be portable. Six of the 9 inch 
mionitors were to be rack-mount able in a 19 inch rack, the other was to 
be portable. 

3.1. A Video Recorders As originally specified, the system used 
two 1/2 inch video recorders. Because no one existing item fully met 
the specification, that number was later changed to three. As specified, 
the system used two 1/2 inch EIA standard (7.5 inches per second) video 
tape recorders. They required a capability to record at both normal and 
slow (time-lavse) speeds, with normal, slow, and still frame play back. 
Slow speed recordings were to be capable of being played back at normal 
speeds to produce "fast" motion. They required a minimum resolution of 
300 lines at normal recording speeds. The recorder was to accept one 
composite video input and provide an output of 1.4 volts. The minimum 
signal-to-noise ratio acceptable was 40 db. One microphone input and 
one line input was required. One line output required an audio response 
of 30 Hz - 5 Khz and an audio signal-to-nol'.e ratio of 35 db. In addi- 
tion, it was desired that the recorders have electronic editing capability, 
and provide for remote operation. 

The basis for specifying a 1/2 inch tape recorder was a combination 
of cost and technical considerations . One inch machines produce high 
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resolution^ but they require more careful operation, are not as rugged 
or as simple to operate, and cost thtik to four times more than 1/2 inch 
machines • 

The maximum resolution attainable with 1/2 inch machines is in the 
300 line range. This is les6 than was available from the cameras, but 
recorded observations were only one feature of the requirement, and did 
not affect; direct monitoring. 

Since the utility of slow, fast, and stop action were to be evalua* 
tedt these features were also specified. The new EIA standard tape 
speed of 7.5 inches per second was specified to ensure compatibility 
across other standard machines* This feature is expected to be of 
increasing value in the future as such recorders becojie more common. 

There are several other features that were specified as being 
desirable if they could be obtained without sacrifice. These included 
electronic editing and remote control. Current 1/2 inch machines offer 
various combinations of these features, but none offers them all. 

3.1.5 Audio Equipment The audio systems specified were designed 
to serve in two specific applications, instructor training and jet air- 
craft mechanic testing. The reqtdrements cf these two areas were entirely 
different. 

In instructor training, there was a requirement to pick up and record 
the continuous discourse of students and instructor, necessitating full 
room coverage. This might have been accomplished with one very expensive, 
centrally located microphone, which would have eliminated the need for 
a mixer. Such microphones are very delicate, and the cost would have 
exceeded that of the specified design. 

A conventional design was recommended consisting of four area micro*- 
phones for students and two fixed microphones for the instructor. These 
were fed into a mixer for input to the recorder. Cardioid-type microphones 
were selected to give wide horizontal coverage with a high front-'to^back 
ratio, and to eliminate unwanted reflections. 
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Response characteristics were specified for the microphones, which 
ensure adeqtiate quality and intelligibility of voice recordings. Th<^ 
low impedance feature reduces noise in the cables, especially when longer 
cables are used. The sensitivity specified (-54 db) was to ensure pick- 
up of normal voice levels at an average distance of about 6 feet. 

For the Ji^t aircraft mechanic application, in contrast, a communis- 
cation system rather than a recording system was required. A separate 
intercom system was therefore specified, to provide two«*way voice 
communication between student stations and the video console. 

3«1«6 Lighting Equipment Although high sensitivity cameras were 
selected to reduce the need for supplemental lighting, some fill and 
base lighting was anticipated as required when operating In areas of 
uneven light levels, such as in the hangar. A 600-watt incandescent lamp 
will give at least 12,000 lumens. This will illuminate a 27 square foot 
area with 125 foot-candles uniformly, assuming a utilization factor of 
1/3, which is realistic. These 125 foot-^candles on a target having an 
average highlight reflectance of 50 percent, will throw about 4 foot- 
candles on a vidicon photocathode under the following circxnnstances: 

Lens stop - 5/1& 

Object distance - 40 times lens focal length 
Lens transmit tance - 80 percent 

This is a worst case condition, i.e., with no light sources other 
than the lamp. Four foot-candles on a high-sensitivity vidicon is enough 
for a goud image. Normally a lamp can concentrate its flux on smaller 
areas; usually there is ambient lighting. Therefore, enough light can 
be provided by a single 600^att lamp to obtain optimum signals in most 
expected applications of the system. 

3*1»7 Auxiliary Equipment A central synchronization signal gen- 
erator was required to provide synchronous signals from the cameras and 
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ensure synchronotis signal processing at all points in the system* Speci-* 
fied was a synchronization generator which would produce standard EIA 
sync, with vertical and horizontal drive and mixed blanking* It required 
an output of 4 volts poalc<-to*peak, operation on 120 volts AC, 60 Hz, and 
a size to fit in a rack panel of 3 inch height* 

Special effects generators provide a capability to combine multiple 
camera images on a single screen, as in ''split screen*' pictures* Such 
devices can be obtained with a wide range of capabilities; the more 
complex ones are more appropriate to commercial production than video 
observation* It was desirable, however, to provide a capability to com- 
bine two signals in a single monitor presentation for recording or scoring* 
Specified were two special effects generators able tc combine camera out- 
puts split horizontally or vertically, with a variable field size* 

One limitation of less expensive special effects generators such 
as those specified is that the overall size of the image cannot be 
reduced. If half of one camera output is being viewed, then only half 
of the total pieture is available, not the whole picture in reduced size* 
This means that the camera may have to be repositioned to capture the 
specific detail of interest* Two of these devices were recommended for 
the system, to provide flexibility in combining camera shots and in 
feeding such signals to the two video recorders* They were required to 
produce output of 1*4 volts to a 75 ohm impedence, from 1*4 volt, high 
impedance input, and to fit a 3 inch rack panel* 

Video switches permit flexible use of several cameras* They control 
which images are reproduced on which screens, and how signals are routed 
through the system* Pulse distribution switching amplifiers were speci- 
fied to ensure constant strong signals throughout the system* 

3*1*8 Mounting Equipment/Hardware Six tripod-type camera mounts 
capable of supporting 10-13 pounds, and two capable of supporting 20-25 
pounds were recommended as basic camera mounts* In addition, the class- 
room area required two fixed, manually variable pan and tilt units that 
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would support 10-15 poir.ds. Two medium duty remote control pan and tilt 
units with standard 355° pan and ± 90° tilt capability were to be used 
for the remote cameras. The remote control panel was to provide control 
of the camera angle (pan and tilt) as well as of lens operation (iris, 
focus, and zoom); all modxiles were to be rack mountable. A console at 
least 40 inches wide was specified to mount six 9 inch monitors, con- 
trols, video switchers, pulse distribution amplifiers, intercom, and 
special effects generators. An additional rack, with wheels, was needed 
to carry the three tape recorders, one 17 inch monitor, and one 9 inch 
monitor. 

3.2 SELECTION OF COMPONENTS 

B:i3ed on the specifications just outlined, specific components 
available commercially were selected. Selection was made on the basis 
of minimum cost to meet specified functional criteria, and on compat- 
ibility when combined in a system. Minor adjustments of specifications 
were necessary. Table 2 (following on pages 39-49) lists equipment 
recommended in the Phase II project report (20 November 1972). Further 
changes were to be required in the course of procuring the equipment. 

Table 3 (page 50) compares low-cost video tape recorders in refer- 
ence to their varying capabilities. It will be observed that no one 
machine provide all the required features. This fact eventually led 
to procurement of two Javelins, for time-lapse capability, pltis an 
additional Pansconic NV 3040 for its remote control capability. 
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TABLE 3. COMPARISON OF VIDEO TAPE RECORDERS 





Time-Lapse 
Recording 


EIA-J 
Standard 


Remote 
Control 


Electronic 
Editing 


Electronic 
Cueing 

1 


Stop 
Action 


Slow 
Motion 


Sony 


No 


Yes 


No 


Yes 


No 


Yes 


No 


AV3650 
















Concord 


No 


Yes 


Yes 


No 


Yes 


Yes 


No 


VTR-850 
















Concord 


No 


Yes 


No 


Yes 


No 


Yes 


Yes 


VTR-820 
















Concord 


No 


Yes 


No 


Mo 


No 


Yes 


No 


VTR-800 
















Javelin 


Yes 


Yes 


No 


Yes 


No 


Yes 


Yes 


X-400 
















Panasonic 


Yes 


No 


Mo 


Mo 


No 


Yes 


Yes 


NV-8020 
















Panasonic 


No 


Yes 


No 


Yes 


No 


Yes 


Yes 


NV-3020 
















Panasonic 


No 


Yes 


Yes 


Yes 


No 


No 


No 


NV-30A0 
















SlJbadey 


No 


Yes 


No 


Yes 


No 


No 


Yes 


-5100 
















Ode tries 


Yes 


Yes 


No 


No 


No 


Yes 


Yes 


TL500 
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^ SECTION 4.0 SYSTEM ACQUISITION 



When the video monitoring system had been fully specified^ URS/ 
Matrix proceeded to acquire that system as hardware. This section 
describes the process by which it was acquired in its final configuration. 

4.1 PROCUREMENT OPTIONS 

Having specified a set of preferred off-the«-shelf components » URS/ 
Matrix had the task of assembling these components into a console with 
peripherals » and testing its operation. It was determined that this 
should be done by subcontracting to a firm which specializes in such work. 
Two reasons prompted this decision: firsts such firms have direct contact 
with the myriad of suppliers who are Involved in furnishing components for 
complex systems. Second^ they have specialized facilities and resident 
talent » able to deal most economically with the problems which arise in 
mating components to form a complex system. That talent includes elec- 
tronic technicians and engineers. Facilities include specialized work 
spaces^ test equipment^ tools » and on-hand supplies of cable ^ connectors 
and small parts. Matrix considered performing the work of systems inte- 
gration directly^ hiring In-house talent on a short-term basis ^ but 
decided that to do so would be expensive in terms of time and would risk 
unforeseen complications. In-house assembly can be recommended only for 
organizations having In-house shop facilities ^ and personnel with exper- 
ience in video electronics. 

Proceeding this way^ an early question is at what point the sub- 
contractor should be brought into the project. An Important consideration 
in this decision is the amount of In-house video expertise available 
during preliminary design stages. In general ^ URS /Matrix feels that it 
is advisable to proceed as far as possible into technical design with 
independent resources, rather than to depend upon a contractor working 
from functional specifications. For this project, URS /Matrix had a video 
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engineer available to work and consult during the design phase • He 
provided the project manager with Independent and objective guidance 
concerning technical feasibility of the functional options which were 
^elng considered* 

When such advice has to be sought from potential contractors » their 
answers are often less than adequate because more careful analysis Is 
required than they can afford to undertake prior to having a cpntract. 
Thust the system designer can at this point find himself with a circular 
problem: The functional excellence of any system depends on specifying 
to the contractor a design which is technically feasible. This presimes 
design requirements which have been refined to the point at which all 
component interactions are known to be within the limits of technology. 
A vendor^ however » cannot give the required level of attention to the 
problem until there is a contract. As a result » the system procurer may 
be unsure of the true technical feasibility of what he is attempting. 

There are two ways of proceeding from this point. One is to have 
experts on hand (or to seek independent technical opinion by paying for 
it) . The other is to choose the most reputable contractor available and 
let him "iron out the details" » being prepared to make trade-offs during 
the process 9 to give up some desired capabilities » and to shoulder addi-- 
tlonal costs. 

Since URS/Matrlx had access to technical talent » it elected to take 
full advantage of it^ and permitted the investigation of functional 
feasibility to proceed to the point of detailed system design and equip-- 
ment capability specification. URS/Matrlx may have proceeded too far 
into technical design ^ since contractors apparently are not accustomed to 
responding to this type of detailed specification. A description of the 
bid solicitation process will illustrate. 

4.2 COMPETITIVE BIDDING 

Our detailed design specifications were sent to contractors to solicit 
competitive bids. The apparent result of providing such detail was that 





the overall system concept was not readily apparent to potential bidders. 
Eventually the system had to be discussed and explained directly to each 
of the Interested bidders. This condition resulted primarily from the 
uniqueness of the system concept , and preconceptions which bidders had 
as a result of their familiarity with more conventional systems. 

Once the function and specifications had been explained, the number 
of bidders decreased. Bidders must be able to estimate reliably both 
hardware costs and the amoimt of labor which will be required to assemble 
a system and to be sure that It works as specified. Not many companies 
were ready to enter fixed-price contracts that required them to deliver 
a fully functioning system. They were willing to propose equipment costs 
and labor rates for system assembly, but not a firm fixed-price quotation. 
It apparently Is not customary for such firms to respond to someone else^s 
design. Several questions were raised by bidders which Indicated their 
belief that, becatise of the completeness of design specifications, some 
other firm must have done the design and that we were soliciting only 
token competitive bids. Obviously, few firms would bid under such condi- 
tions. Only when they were assured that the design was done In-house, 
and that all bids would In fact receive equal consideration, were we able 
to attract multiple bids. 

Considering the way In which video equipment vendors operate, compet- 
itive bidding does not seem to be the most useful approach to system 
acquisition. This is most particularly true when there Is great reliance 
on the system assembler for technical design advice. If one Is Interested 
primarily in equipment, and in relatively few or single services, then 
competitive bidding may be a more useful procedure. 

Once the detailed functional and technical description was communi- 
cated to the bidders, they each proceeded to respecify the system in their 
own format and conventions. Apparently this was one of l:he problems with 
the drawings which we provided; at the shop and detail level there is a 
certain variability in the conventions and assumption? used* To some 
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extent our analysis resulted In a design which was too detailed , In that 
It had to be restated In the vendor^ a terms. Had we been able to Identify 
the vendor sooner we might have saved some of this time and energy. 

On the other hand, before we went to the vendors we had made certain 
that what we were proposing to do was technically and commercially 
feasible , using currently available components. In preparing systems of 
unique design, more is required than a cursory analysis of the require^ 
ment and of possible solutions. Someone has to pay for this either the 
original analyst or the vendor. The more completely the analyst has 
proven feasibility and the more equipment Independence he has achieved, 
the higher the probability that he will achieve a solution which Is 
optimum to his original concept, and unconstrained by the limitations or 
preferences of the vendor. 

If competitive bidding Is not satisfactory, how should a video con«- 
tractor be selected? There are several considerations, not vastly differ- 
ent from those for selecting any other kind of contractor. First, the 
contractor must have sufficient staff and talent to ensure his ability 
to perform the work. Then he must show evidence that he grasps the 
problem you are presenting, and is able to suggest viable solutions. 
Experience and reputation are other Important indicators, and the best 
way to Judge the ^ is to review his work for prior clients, and if 
possible, discuss his work with them. Applying this type of scrutiny to 
the available video contractors will reduce the field of available choices 
to a manageable number very readily. 



4,3 ACQUIRING THE SYSTEM 

We have described difficulties encoxmtered in subcontracting for 
procurement and integration of the video system. The impact of these 
perturbations in the contracting process was to prolong the period between 
system design and system fabrication by approximately 3 months. The 
Intervening time was spent in soliciting, explaining, clarifying and 
negotiating. In retrospect, we believe that this time loss could have 
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been reduced If the contractor had been chosen on a basis other than 
cost quotation, and had been brought Into the project at an earlier 
stage to work with our In-house technical personnel. Doing so would 
have reduced system design expense by eliminating dxipllcatlon In detailing 
the design, and by saving the time required to revicf* and clarify the 
system with a multiplicity of bidders* 

Again, we are speaking of a system unique In design and functional 
concept, as contrasted to systems which may have been repeatedly made 
before. The considerations raised would be even more forcefully relevant 
to any system which employs specially designed or modified equipment. 
While we foctised. In this project, on of f-'the-^shelf components,' there 
were several points at which It would have been desirable to modify com- 
ponent capabilities, or to have a special purpose item built. Such actions 
could be expected to add considerably to the time and effort spent in 
system development. 

The contract which was eventually let for the system specified the 
equipment to be purchased, the fundamental capabilities reqtdLred of the 
system, the general console configuration (by a drawing) , the costs to 
include all labor and equipment, and a delivery schedxile. The main time 
consideration for the contractor was that which would be required to 
acquire components from manufacturers and suppliers. In the system there 
are approximately 100 line items, which had to be secured from numerous 
different sources. The contract called for delivery of the system in 
90 days. It took the first 60 days for the contractor to receive enough 
materials to begin. At 90 days the system was 90 percent complete, but 
delay in delivery of several key components delayed completion of the 
system for approximately an additional 30 days. 

As soon as the system was sufficiently assembled to permit meaningful 
appraisal of the physical layout (at about 75 days) , but while changes 
could still be made without causing major setbacks, the designers took a 
careful look at its configuration. This procedure is highly recommended, 
since it provides the opportunity to correct oversights or make adjust-* 
ments in design. At the time this review was made, most major components 
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were In position buL were not Interconnected or functioning. Several 
changes were made as a result of this review. For example, panel doors 
were modified for better access to connector panels, controls were 
shifted aroundj the top row of video monitors was tilted forward 30^ for 
improved visibility, and casters were added to the consoles. These 
changes Improved system operation and transportability. 

Another physical review of the system was held at the time originally 
scheduled for completion, as had been stipulated In the contract. Its 
purpose was to verify that all the required functional capabilities of 
the system were present and operational. Checks were made of capabilities 
such as being able to Inter-record between VTR's, to combine cameras on 
the special effects generators, and to record Inputs from the sequential 
switcher. Individual components were verified as balng In good working 
order. This system review had to be conducted In part by using some 
borrowed equipment In place of components which had not been received, 
but It demonstrated that all functional requirements were met. On the 
other hand. It demonstrated that there were problems remaining In elec- 
tronic alignment of the components, some cables to be bundled, and other 
minor problems to be taken care of prior to arrival of the remaining 
equipment . 

A third check of the system was made at the time of completion and 
preparation for shipment. The purpose of this check was to verify that 
identified problems had been corrected and to Inventory the equipment 
for shipment. 

In addition to performing these system checks, URS /Matrix personnel 
were in frequent telephone contact, resolving questions such as recommen- 
dations from the contractor for more efficient interconnection of equip- 
ment or substitution of an alternative brand of component. A member of 
the URS/Matrix staff spent time at the contractor's facility during 
set-up for the functional tryout, to learn how to set up and adjust the 
equipment. Such close contact during equipment fabrication is necessary, 
and is recommended. The contractor must, of course, clear every alteration 
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or change from the approved plen with the eyetem dealgaer so thet the 
Impact of any change can be evaluated on such paraMters as cost» 

function, and time. Only under this condition can the designer be 
confident that the final system will meet his original intent as closely 
as possible. 
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SECTION 5.0 DESCRIPTION OF THE VIDEO SYSTEM 

Section 3.0 detailed the process by which technical specifications 
for the video system were developed, and outlined those specifications 
as they existed prior to procurement of the equipment. Section 4.0 
described the processes of integration of components into a system, and 
acceptance testing. In the course of these actions, certain minor 
changes were necessary in system configuration and selection of components. 
Those changes were required as the result of problems of component com- 
patibility, and failures of certain components to concorm with advertized 
specifications. At the same time, minor improvements in system config- 
uration and capability were recognized as feasible at no significant 
cost, and were incorporated. 

This section describes the system, in operational terms, as it was 
finally delivered and now exists (December, 1973). The role of certain 
features in accomplishing program objectives will be discussed. 

5.1 SYSTEM CONFIGURATION 

The experimental video system was designed to provide a means for 
Investigating questions concerning the application of video technology 
to technical training, according to the rationale described in Section 
2.0. It was designed specifically for application in the three training 
environments specified in Section 2.0; in addition it was designed to offer 
i.aximum experimental flexibility in further study and development, else- 
where in the USAF technical training environment. 

The design concept was that of a system flexibly adaptable to video 
monitoring and recording of student performance in training. It was 
designed as an experimental tool, to be used in developing techniques 
for video in testing and performance monitoring. For these reasons, the 
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system was designed so that It cpuld easily be assembled In special 
conflgutatlons suited to particular research or training tasks. 

During the study of USAF practice described In Section 2.0, three 
specific USAF training activities were selected as initial points of 
application. The system will be described in terms of the three conflg«> 
uratlons finally used during those on-*slte system tests. Treated first 
will be the system as it was applied, in its fxillest configuration, to 
study jet aircraft mechanic performance testing. 



5.1.1 Full System Configuration (for Jet Mechanic Area) This 
application employed all components and subsystems of the video system. 
Major, components are: 

Eight video cameras, two remotely controllable, which can be poai^ 
tloned at selected testing positions. 

Two time-lapse video tape recorders, which offer options of stan- 
dard, speeded, slowed, and sto-frame playback. One remotely 
controllable video recorder. (Only two of the three rjecorders can 
operated at any one time.) 

An audio recording system. Six microphones, input to two audio 
mixers, for output to video recorders. 

A sequential switching device, which permits the output of up to 
four cameras to be displayed on one monitor. 

Two special effects generators, to combine up to 4 input channels 
as split-screen displays. 

Continuous video monitoring for four cameras (four monitors). 
Sequential or manually-switched monitoring for four other cameras 
(one monitor). Continuous monitoring of the output of each special 
effects generator (two monitors). Continuous monitoring of two 
recording channels (input or playback) (two monitors). 

A two-way push-to-talk Intercom system for coromuni eating between 
the system console and the testing stations. 

A central control console. Figure 1 is a representation of the 
control console. 



5.1.2 System Configuration for Power Lineman Area In the power 
lineman field test, only a portion of the equipment was required. For 
this reason the full system was designed to permit needed components of 

6l 



eiSr COPY AVAilABLE 




Figure 1 - Full Equipment Console 
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thft •qulDBtnt to be extracted, and xised/la^a alsq^ler Independent conflg- 
uretlon. Thla break-out feature nakea tranaportatlon to a remote area 
easier. Including such a feature In an experimental system resulted In 
Increased design and development costs; an operational application, on 
the other hand, would use only the simpler configuration, and achieve a 
lower equipment cost. The major components used In this configuration 
were: 

^o remote control cameras used to track students climbing poles. 

Two recording channels, one with a special effects (split screen) 
capability* 

Monitors dedicated to each camera. 

Figure 2 shows the arrangement of equipment and controls on the 
mobile console. 

5.1.3 System Configuration for the Instructor. Training Area The 
concept emplo> in the Instructor training field test differed slgnlfl*- 
cantly from ol applications. In that test, the system did not have 
an operator. It was designed so that the student Instructor could 
activate the system at the beginning of his presentation, and shut It 
off at Its conclusion. The tape could then be reviewed at any subsequent 
time. During the experimental evaluation period, URS/Matrlx research 
personnel were present to set--up, adjust, and monitor the recording 
process. Major components en^loyed In this application were: 

Two fixed position cameras, one facing the Instructor and the other 
fixed on the students. 

Two recording channels, one with special effects capability. 

Multichannel audio Input to record both Instructor and student audio 
outputs. 

The console configuration used for this application will be the same 
as that used In the power lineman area (Figure 2). 
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Figure 2 - Partial Equipment Console 
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5.2 APPLICATION OF SYSTEM FEATURES 

Table 4 Is a tabulation of system features. In terms of the context 
In which they were experimentally applied, with their expected utility. 
We might theoretically have wished to apply and evaluate each feature In 
all applications. However, training environments are highly diverse; 
each application presents unique requirements for monitoring and measure- 
ment Information, but no application requires all features. Precisely 
for that reason the system was developed to provide greater experimental 
flexibility than Is required for any one application. 

As can be seen from the table, the hangar area - Jet mechanic appli- 
cation - offered the widest range of opportunity for examining systems 
feature utility. 

On the other hand, the power lineman test permitted studying the 
u::lllty of video to monitor an otherwise Inaccessible task performance, 
and to apply speeded playback. Similarly, the Instructor training appli- 
cation permitted study of "operator free" use, and use of recorded sound. 

5.2.1 Time-Lapse Recording "Time lapse" video recorders offer a 
capability to play-back action at fast, rormal or slow speeds, and In 
stopped- frames. The particular recorder used Is Javelin model XAOO, 
which can be used In the following modes: 

S tandard 

Recording at standard spaed of 7.5 tape-Inches per second with play- 
back at standard speed produces a standard video presentation of 30 frames 
per second. Tape reels can be obtained In either 30 or 60 minute lengths. 

Slowed Motion 

Recording at standard speed and playing back In LONG PLAY produces 
a slow motion effect by reducing action to l/7th normal speed. 

Long Play 

Recording at LONG FLAY speed and playing back at the same speed, the 
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equipment records only 5 frames per second as contrasted to the normal 
speed of 30 frames per second. Thus, the viewer sees a slightly jerky 
or discontinuous motion. Tape Is conserved, and 7 hours of video can 
be recorded on a standard 1 hour tape. 

Accelerated Motion 

Action recorded at slow LONG FLAY speed and played back at standard 
speed Is seen as accelerated motion , 7 times actual speed. 

Stop-Frame 

Action recorded at either speed can be stopped, the equipment then 
replays the same frame as long as may be needed. In addition, the Javelin 
recorders are equipped with a special control for advancing the tape 
manually from one frame to the next. 

The utility of this capability was examined In several contexts. In 
the task quantification process, It was anticipated that the slow and 
stop motion features would be useful when Identifying criterion evaluation 
points and when examining performance sequences. The speeded motion cap- 
ability was used experimentally as a means of efficiently sorting through 
quantities of recorded performance In order to find criterion sequences. 
It was of Interest to determine which types of task could be followed 
and Interpreted during speeded playback, and which could not. 

5.2.2 Tape-to-Tape Editing The video system has two recorders 
available to permit tape-to-tape transfers. Thus, when material has been 
reviewed and evaluated, selected portions can be compiled onto a new 
tape. 

5.2.3 Remote Camera Control A remote control capability (azimuth, 
elevation, focus. Iris and zoom) has been provided for two of the cameras 
In the system. The primary benefits offered are camera savings, operator 
savings, and an ability to track or observe actions not otherwise moni- 
torable. In the jet mechanic area, remote control made It possible for 
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a single camera to pan to two or more test positions* Where a camera 
operator might otherwise be required ^ It made It possible for Instructors 
at the console to perform adjustments needed to track subject motion » 
to frame pertinent action and to focus for close-'up shots* In the power 
lineman area^ a remote camera was ^essentlal^ since fixed cameras could 
not track a man climbing a pole* Considerable operator loading costs 
are Imposed by remote cameras; the benefits must be assessed In terms 
of those costs* 

5*2*4 Special Effects Generator The special effects capability 
to combine two Images on a single screen was employed In several ways* 
In the Jet mechanic area It was used during live observation to provide 
two views (l*e*, a close-up and an overall view) of a given operation 
and to put views of two different operations on a single screen* It 
was employed In the same manner in the power lineman application* In 
the Instructor training application, the split screen was used to combine 
a synchronized display of two views » Instructor and students* It might 
further be employed to Insert a meter » clock or scope display adjacent 
to subject performance 9 or to compaxe a criterion and a test performance 
side by side* 

There are several known, difficulties of split screen displays which 
were examined* The first Is that the special effects generator splits a 
camera's picture In two, rather than providing a reduced version of the 
whole^ picture* This had implications for camera positioning to Insure 
capturing the desired detail* A second drawback is that the special 
effects generator degrades the picture signal somewhat* This is especially 
critical when that signal is to be recorded, since recording produces 

further loss of net resolution* 

« 

5*2*5 Automatic Tape Indexing In collecting any significant amount 
of data on video tape, it becomes a considerable task to keep track of 
the points on tape at which specific events are recorded, and an even 
greater task to retrieve those data in any order other than that in which 
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they were originally recorded. For these reasons » an optimal systMi 
would be one which offered an automatic means of logging recordings, and 
relocating uhem at their tape addresses. In the absence of such a cap^ 
ability » the conventional practice is to keep a written log, identifying 
discreet sequences by tape number, with locations on tape shown by an 
index counter or footage meter. This practice is cumbersome » and impoaas 
a high opera tor**time load. 

No ideal capability of this kind exists or can be economically 
assembled. As an alternative » a Panasonic VTR model NV 3040 was idanti* 
fied» and procured as a third VTR. This VTR has two features to assist 
in relocating specific sequences. The first of these is a mechanical 
device associated with the index counter on the recorder. When this 
device is engaged by setting a switch » the recording will automatically 
rewind to the zero position. Zero> can be set at the beginning of the 
tape, or at any other tape position. Since the recorder is equipped 
with a remote control » an instructor-console operator can eiaply prass 
the rewind switch and continue another task while the recorder ratitraa 
to the chosen (zero) setting. If » in recording or reviewing a tmp^f the 
operator observes an event which he will want to review, he resets the 
counter to zero at that pointy and when he rewinds the recording will 
stop at the same point. This capability is limited because it provldea 
only a temporary index » only one address » and that addreas can be raacbed 
only by rewinding » not forward aearchlng. 

Multiple Indexing is potentially possible with this recorder, but 
would require additional equipment » as well aa manually inserted metallic 
foil sensors on the video tape. Because the tape transport is electrl-* 
cally (not mechanically) controlled^ it lends Itself to automatic control 
systems. The manufacturer now furnishes an adapter which will control 
play and rewind between any two marked points on the tape. This feature 
is not a practical method for marking multiple addresses on the tape in 
USAF applications » and therefore^ it was not acquired for the system. It 
can be added. in the future^ if desired^ or electronics might be fabricated 
to provide a leas cumbersome 8earch«*and-stop capability. 

TO 



la a&y cat*, tuch a capability dependa on a raaota-controllad 
(altctrlcally coatrollad) tranaport dack. The Panaaonlc racordar waa 
piocund for tha ayatam becauae of it a return-aaarch capability, ita 
^tantlal for adaptation, and ita remote control capability which will 
ba dlacuaaad In the following section. 

^•2.6 Remote Recorder Control A problem in applying vldao tach- 
nlquaa ia the load imposed on the user by recorder operation. Due to 
limitations in off-the-shelf technology, the video system la laaa than 
optimum in this respect. Time-lapse recorders were not available with 
remote control, so for time-lapse recordings an operator must physically 
go to the recorder and manually control each operation. An alternative 
is offered by the Panasonic recorder, which can be controlled by a 
remote-control keyboard. For reasons of system flexibility these con- 
trols were not built Into the console, but they can be located within 
the Immediate area for easy access by the operator. 

5.2.7 Sequential Switching A sequential switching device is 
provided, which controls the outputs of four cameras (numbers 5-8) to a 
video monitor. This switch can be controlled to select one to four 
cameras In sequence, each for a standard Interval controllable from 1 to 
58 seconds. Alternatively, It can be used as an electronic switch, to 
select the output of any one camera for uninterrupted display. This 
feature was employed In the jet mechanic tests as an alternative means 
of monitoring student performance. It was not used in the other appli- 
cations, since they employed only two video cameras. 

5.2.8 Cameras and Monitors The multiple camera and monitor cap- 
ability Is designed to permit study of the range of operations which can 
be monitored simultaneously by an instructor under different modes of 
live observation, recording, and mixes of the two. In combination with 
the sequential switching device discussed previously. It also permits 
examination of full-time versus sampling display techniques, 
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5. 2.9 Mirrors Mlrrois were used In the jet mechanic test to pro- 
vide visual access to student performance. This area Is the only one 
which contained severe access problems. 

5.3 OPERATING THE SYSTEM 

An objective of this project was to design the video observation 
system so that It will augment Instruction without requiring numerous 
additional personnel or Imposing self-'defeatlng operational loads on an 
Instructor. This subsection describes personnel workloads Imposed by 
the system In terms of specific control operations. In general, the 
system Is designed to be operated and controlled by one Instructor- 
operator, without additional operators either at the cameras or &t the 
console controls. Using the system will require time and attention, at 
the expense of other Instructional duties. The hope Is that In any 
application a total saving of time will result, as compared to gathering 
the student Information concerned by alternative, non-video, means. In 
some cases. Information can be acquired which Is not available by any 
conventional means. 

The Instructor-operator who Is referred to In the following para- 
graphs Is the console operator just described. He will be variously 
referred to as an operator or an Instructor, depending on the task being 
described. 

As has been observed before, the video observation system was designed 
to Incorporate a wide range of capabilities In monitoring, signal pro- 
cessing, recording and display of audio-visual data. This range of cap- 
abllltl^-^s Is used to adapt the system to widely differing needs In 
training and human measurement. For any one application, not all cap- 
abilities of the system are required. The system Is therefore designed 
so that, by switching. Its various components can be flexibly Inter- 
connected to fit the needs of any task at hand. It Is possible, further- 
more, to use the system In less than Its fully physical configuration. 
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For Instance, a particular project may require only one camera and 
recorder, In which case only one camera, one bay and one rack need be 
transported and set up In the project area* 

Figure 3 represents the console (bays and racks) , set up In Its 
fullest configuration, with notation of the location of functional areas. 



5.3.1 Functional Areas In the Control Console The console consists 
of two bays and two racks. It houses the principle components other than 
cameras, and provides the control, monitor, switching, recording, and 
display capability by which flexibility Is achieved. The major components 
are: 

At (A) In Figure 3, monitors which continuously display the outputs 
of cameras 1 through 4, and Indirectly display outputs of cameras 
3 through 8. 

At (B) , a two-way push-to-talk Intercom system for communicating 
between the system console uvi student stations. 

At (C) , controls for remote adjustment of the two remotely controlled 
cameras 3 and 4. 

At (D) , a sequential switching device , which permits the output of 
up to four cameras (5 through 8) to be displayed on one monitor 
(marked (A,D)) . 

At (E) , two special effects generators , to combine up to 4 input 
channels as split-screen displays. 

At (F) , a switching 'group by which connections are made between the 
components shown. 

At (G), three video tape recorders . Two VTR's which offer options 
of standard, speeded, slowed, and sto-frame playback, and one 
remotely controllable VTR. (Only two of the three recorders can 
operate at any one time.) Two monitors display what is being 
recorded or played back. 



5.3.2 Cameras The video system provides eight cameras, of which 
six are fixed-position type and two are remotely controlled. 

All cameras can moved about on their tripods within a distance 
of 65 feet from the console (the length of their cables). 

The fixed-position cameras are most effectively used where the 
target area can be pre-defined, and when the focal length of the 
subject within that area does not shift significantly. 
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The remote control cameras can be controlled from the console in 
pan (horizontal azimuth) tilt (vertical elevation or depression) 
zoom 9 focus 9 and Iris opening* 

Outputs of cameras 1, 2> 3, and 4 are displayed at the top monitors 
of Bays 1 and 2 ((A) In Figure 3)... - ^ * 

Outputs of cameras 5, 6» 7 and 8 go first to the sequential switch 
((D) on Figure 3) » and then are displayed, one at a time, on the 
SEG monitor (A,D) In Bay 1. 



5 •3.3 Sequential Switch Outputs of cameras 5 through 8 enter the 
console through the sequential switch in Bay 1, marked SEQ on Figure 1, 
and Illustrated In further detail by Figure 4. This switch selects one 
camera at a time, displays that video signal on the monitor to the upper 
left of the switch, and makes the signal available at the switching 
group for further use. 

The "sequence" toggle switch (Figure 3-3) controls the mode of oper- 
ation of the SEQ. When It Is set on "manual", sequencing of the 
switch Is controlled by pressing the "manual" push button switch: 
Each time that button Is pushed, the switch will turn to the next 
camera. In sequence by number from camera 5 through 8, 7, 8 and 
then back to 5. When switched to any camera It will remain In that 
setting until the "manual" button Is pushed again (or until the 
toggle switch Is set to "auto". See following.) 

One of the channel Indicator lights Is lit at any time, and Indicates 
which camera Is currently selected. Lights 1 through 4 represent 
cameras S through 8, respectively. Lights 5 and 6 are Inoperative. 

When the sequence toggle switch Is set at "auto" , the switch auto- 
matically changes cameras after a fixed Interval which can be varied 
from approximately one to approximately sixty seconds. In other 
words, at this setting the switch will connect and display on the 
SEQ monitor first the output of camera 5, then that of camera 6, 
then 7, then 8 then back to 5, Indefinitely. 

The "time" knob controls the number of seconds that each camera Is 
displayed, from one to about sixty seconds. 

The "camera In" knob can be used to control the number of cameras 
being monitored. With the setting at "4", all four cameras (numbers 
5 through 8) are selected In sequence. Turned back to "3"- camera 8 
Is dropped and the switch cycles from number 5 through number 7 and 
back. Turned to "2", It alternates cameras 5 and 6, and at "1" It 
will select only camera number 5. Positions 3 and 6 are Inoperative. 
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Figure A - Sequential Switch Controls 

76 




The "function" switch Is Inoperative, and will remain set on "master". 

To summarize : The SEQ controls video Input from four cameras 
(numbers 5 through 8) to a video monitor and to the console. This 
switch can be controlled to select one of four cameras In sequence ^ 
each for a standard Interval controllable from one to slaty seconds. 
Alternatively^ It can bemused as an electronic switch, to select the 
output of any one camera for uninterrupted display. 



5.3.4 Synchrpnlzatlon Signal Generator In Bay 2, centered above 
the switching group, Is a synchronization generator, marked SYN In 
Figure 1. It operates contlnuotisly and provides synchronization signals 
to other equipment. It requires no control or adjustment except to 
observe that the pilot light Is on. 

5.3.5 Special Effects Generators Two special effects generators 
are located In Bay 2, one on each side of the SYN and over the switching 
group (marked "SEG" on Figure 1). 

Each SEG has a capability to combine the outputs of two cameras into 
a single video picture output. It can split the screen horizontally or 
vertically, or Insert one picture into the comer of another; the posi- 
tion and size of the Insert can be freely varied. SEG outputs are 
displayed on the SEG 1 and SEG 2 monitors, in Bay 1. 

To operate a SEG it is necessary to first select two cameras for 
input, and connect them to the SEG using the switching groufx (as described 
in paragraph 5.3.6). One camera - the one selected on the upper switching 
panel, can be regarded as forming the basic video picture, while the 
other, selected on the lower switch panel, can be regarded as an insertion 
onto that picture, replacing one comer of the picture on the monitor 
tube. 

The second picture is **wlped" onto the first from one of the four 
comers. Select a comer to be used for insertion, and set (he function 
switch at the far left (Figure 5) to point toward the circle the corres- 
ponding comer of which is darkened. 
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The monitor now displays the basic video picture, with a portion 

of the second video picture inserted at one comer as a quarter-screen 
display. 

If only one picture appears, it is necessary to adjust H and V 
WIPE (oee below) . 

The operator sets the horizontal wipe control (H W^|g) to move the 
lower edge of the inserted picture up or down - in other words, to control 
the position of the line dividing one camera input from the other hori- 
zontally. By turning H WIPE all the way to the left, the inserted signal 
can be wiped completely off the screen. By turning it all the way to the 
right, the SEG is made to produce a split-screen display, on which the 
two camera outputs are displayed to the left and right, divided vertically. 

The operator sets the vertical wipe control (V WIPE) in a similar 
manner to control the vertical line dividing the two camera signals. By 
turning V WIPE all the way to the right, the SEG can be made to produce 
a split-screen display divided top and bottom, horizontally. 

The inserted signal and the basic signal are both centered, in the 
SEG display, in relation to the whole monitor tube and not in relation 
to the portion of tha picture field which they occupy. Therefore it 
usually is necessary to realign the cameras in relation to their targets, 
so that the significant target detail is off-center to each camera, but 
centered in relation to that portion of the monitor tube on which the 
camera output is displayed. This is a major cause of operator work load 
in using the SEG. 

Usinji the switching group, it is possible to connect the output of 
one SEG as inwut to the other, and thtw combine 3 or 4 cameras in a single 
SEG display. Some degradation of video signal occurs when SEGs are 
cascaded in this manner. 



5.3.6 Switching Group The switching group on Bay 2 (SWITCH GP on 
Figure 1) consists of six switch panels, each of which controls the inputs 
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to a SEG or a Video Tape Recorder (VTR). Figure 6 shows those switches 
In detail. Collectively, they make It possible to route signals from 
the cameras In a variety of ways for video display or recording. 

Figure 7 Is a block diagram of the video observation system and 
Illustrates how It can be connected. The switching group is represented 
by the box-tailed arrows at the center. Each vertical arrow represents 
one switch panel (seen horlzontalljr on Figure 6), with its output at the 
bottom. Each X represents a push-button on that panel, by which one input 
at a time can be connected into the switch. Horizontal connecting lines 
across the switching group represent continuously connected bus lines, 
which carry the outputs from cameras, SEGs or VTRs, and connect them to 
monitors each of which continuously displays the signal carried on one 
bus lines. Vfhen the button at X is on, the bus line is connected into 
the switch. 

Note at the left (Figure 7) the eight video cameras. Gamers 1 through 
4 connect cirectly to fully conmitted monitors, and can each be further 
connected by pu&h-button switching to an input of SEG-1 or SEG-2, to 
VTR-1 or VTR-2 or (by plug-in connection), to VTR-3. 

Any one camera can be connected to more than one output device at 
the same time: i.e.. Camera 1 to SEG-1, SEG-2, VTR-1, and VTR-2. But 
camera 1 (for instance) could be connected to both Inputs of either SEG. 
(There would be little point in doing so. Two cameras are necessary to 
form a special effects display.) 

Cameras 5 through 8 go first into the SEQ (reference paragraph 5.3.3). 
The output of those cameras is displayed, as the output of the SEQ, one 
' .^:era at a time, on the SEQ monitor. The output of the SEQ can be 
connected through the switching group to either input of either or both 
SEGs, to VTR-1, or to VTR-2 or 3. Because the SEG elects only one of 
cameras 5 through 3 at any time, there is no way that two of these cameras 
can be used or monitored simultaneously. 

The outputs of SEG-1 and SEG-2 are continuously displayed at the 
SEG-1 and SEG-2 monitors. Those outputs can be connected as inputs to the 
other SEG, or to any VTR. 
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Figure 7 - Functional Switching and Control Diagram 
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The output of VTR-1 la contiftuoiiily displayed on the VTR-1 aonltor, 
and can be connected aa Input (for tape editing) to VTR-2 or 3. Output 
of VTR-2 or VTR-3 (whichever la plugged Into the system) Is displayed on 
the VTR-2 monitor, and can be switched as input to VTR-1. 

5.3.7 Video Tape Recorder - Time Lapse Three VTRs are furnished. 
Two of these are Javelin recorders with a time-lapse record capability. 
Thla means that the recorder can be operated at the normal recording/play 
back speed of 30 frames per second, or can record or playback at a lower 
speed - 7 frames per second - to achieve slow motion, speeded motion, or 
tape conservation objectives. 

Thread Tape . To operate. It Is necessary to first thread the recorder 
with video tape. A diagram in the box lid shows how the tape is 
threaded; further Instructions are offered in the Operat:.on and 
Maintenance Manual. 

Turn on Power . Once iuputs to be recorded have been selected and 
switched in, the recorder Is activated by turning on power, starting 
the motor, and depressing the appropriate combination of keys 
(Figure 8). To turn power on (or off) press the POWER switch. This 
switch mjst be on to get a picture on the record monitor. To start 
(or stop) the motor and the rotary heads, press the MOTOR switch. 
This shotild be done only when ready to record or play, and the motor 
should be switched off each time recording or playback is stopped 
for more than a few seconds. In this recorder, anytime the motor 
is on, the recording heads rotate contlniiously against the tape and 
will cause significant wear on that portion of the tape. 

Record. To record at nort'al speed - 30 frames or 7.5 Inches per 
second - push the RECORD (red) button; then while holding that button 
down, press STANDARD PLAY. At this speed, a 7 inch reel records for 
approximately 1 hour. 

Play . To play back at normal speed, press only STANDARD PLAY. 

Slow Motion . To play slow-motion, first record ut normal speed. 
Then play back at slow speed: Press STANDARD PLAY, then LONG PLAY. 

Slow Record . To record at slow speed press RECORD (red); while 
holding it down, press STANDARD PLAY then LONG PLAY. The recorder 
will now record at slow tape speed of l/7th normal speed or 1 frame 
in each seven frames received from a camera. 

Slow Play . To play back at slow speed, press STANDARD I'LAY then 
LONG PLAY. The recorder will play back the action recorder (at Slow 
Record) without distortion of time, but with a motion which may 
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Figure 8 - Control Layout - "Javelin" Time-Lapse Recorder 



appear Jerky. Many tasks can be recorded In this manner without 
serious loss of detail, but at an approximate 85 percent econoiuy 
In tape. 

Speeded Motion. To play speeded motion, first record at slow speed, 
then play back at standard speed. 

Stop Action. To play stop action, play back at slow speed; move 
the STILL lever to the left. This stops the tape. Turn the lever 
knob to the right, the picture can slowly be advanced from frame 
to frame. 

Stop . To stop, press STOP. 

Audio Edit. To edit the audio portion without affecting the video, 
prase AUDIO EDIT (red) , and hold it down while pressing STANDARD 
PUY (and LONG PLAY if the original recording was slow record). 

Rewind. To rewind or move tape forward without playing, press 
REWIND or FAST FORWARD, respectively. 

In addition to operating these controls when recording, the instructor 
will have to keep track of the location on tape of each recorded sequence. 
As was noted before, this will require the maintenance of a recording log 
with readings of the index counters. Any time two recordings are being 
made, operation of the equipment will probably require the full attention 
of the instructor. 



5'3«8 Video Tap e Recorder - Remote Contro l One VTR is a Panasonic 
single-speed recorder. This unit includes a remote control assenily 

GOTO on Figure 1) which ia connected to the VTR by a cable. The control 
unit can be moved to the point at which the operator is seated, and is both 
faster and easier to operate than are controls for the Javelin. In general, 
the Panasonic gives a high resolution of detail in playback. 

Thread Tape. To use, thread the tape following instruction in the 
cover . 

Turn on. Turn on the power and motor. The motor can be left running 
on this equipment, since when it is not recording or playing, the 
tape is automatically lifted ^ff the rotary heads. 

Operate. Press either the remote or regular function buttons, which 
correspond to controls of a conventional audio tape recorder. 

Rewind Address . The Panasonic includes an automatic rewind address 
capability. When this device is engaged by setting a switch, the 
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recording will automatically rewind to the zero position. Zero can 
be set at the beginning of the tape, or at any other tape position. 
Since the recorder Is equipped with a remote control, an Instructor 
at the console can simply press the rewind switch and continue 
another task while the recorder returns to the chosen (zero) setting. 
If, in recording or reviewing a tape, the operator observes an event 
which he will want to review, he resets the counter to zero at that 
point, and when he rewinds, the recording will stop at the same 
point. This capability Is limited because it provides only a tem- 
porary Index, only one address, and can be reached only by rewinding, 
not by foiward searching. 

5.3,9 Remote Control Cameras Cameras 3 and 4 are remotely con- 
trolled. Each control assembly consists of a motorized pan/tllt camera 
mounting assembly, a motorized lens control, and a control console panel 
on Bay 2 (Figure 9). 

The motorized units mounted with the camera are designed for Indoor 
use and can be used out of doors only while fully protected from the 
weather and extreme heat or cold. It Is critically Important to avoid 
pointing either cameras or lenses within 30 degrees of the sun. 

Camera controls are located as shown in Figure 9. Each unit has four 
controls that may be adjusted each time the camera Is moved. Camera angle 
(I.e., pan and tilt) Is controlled by a single "Joy-stick" type of control. 
This Is easy to learn to operate. A complexity is Introduced by lens 
adjustment. There are three separate lens adjustments possible — zoom, 
light (iris), and focus. Facility in making these adjustments is not 
easily learned. The control lor each function is a two-way switch and 
the combination of adjustments that are required for a given camera 
position does not follow a readily discernible pattern. Each setting may 
require a series of trial and error adjustments. 

5,3,10 Audio Monitor and Record Six microphones are furnished, to 
pick up sound and speech for monitoring and recording. These microphones 
are input to the audio mixer, labeled "hax" on Figure 1, Separate gain 
controls on the two mixer panels allow contiol of the volume input from 
each microphone. Output of the upper mixer is combined with that of the 
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Figure 9 - Remote Camera Controls 
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lower (master) mixer control. Overall recording or monitor signal level 
Is adjtisted by the master gain control on the lower mixer. Only one 
sound channel exists. It Is connected to both recorders, and appears as 
audio any time either VTR Is recording. Volume level meters on the mixers 
and recorders are used to recognize when soxmd levels are within the proper 
recording range. 

5.3.11 Inter eom System Intercommunication between the console and 
student stations can be provided by the Intercom unit In Bay 1, labeled 
"COM" In Figure I. 

The master unit Is shown In detail In Figure 10. By pushing any or 
all of the six selector buttons, the operator can select the stations he 
wants, and then must depress the lower button to talk. Students at the 
stations can break In to talk, any time the master station Is silent. 
They must Identify the station from which they are calling. 

5.3.12 Lighting The video observation system Is designed to 
operate, when possible. In ambient light. When that light Is not adequate, 
or where the subject matter to be observed Is In a shadow, and especially 
w^isre fine detail Is to be observed, artificial lighting may be needed. 
Two llglitlng sets of three lamps each are provided. The lights are pro-* 
vlded with barn-door shields and diffusing screens to control glare. 
Glare and reflectance from bright surfaces can constitute a serious 
difficulty, since spots of glare can either block out picture quality or 
damage the cameras. 

5.3.13 Lenses Lenses provided with the system conslflt of six 
25 - 100 mm manual zoom lenses, two 15 X50 mm motorized zoom lenses, 
one 9 mm wide angle lens, and two 2X extenders. In addition, each camera 
Is equipped with a standard fixed lens. 

The manual and remote control zoom lenses extend the capability of 
cameras significantly by permitting a greater range of camera positioning. 
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Figure 10 - Intercom Master Station 
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If the standard lens Is used, then the distance from the camera to the 
target Is quite restricted. Using zoom lenses permits positioning the 
cameras In the most convenient or unobtrusive locations • 

The 2X extenders double the range of the lenses when needed. Use 
of the extender reduces the field, or width of the picture, to the same 
extent that It Increases the size of the Image, and Increases the light 
required on the target for good resolution. 

The 9 mm lens Is a wide-angle lens which permits capturing a broad 
field of view from relatively close distances. Its limitations are that 
it does not have great depth of field, and causes some distortion around 
the edge of the picture. It provides a complementary capability to the 
zoom lenses, in that it provides a great breadth of field, whereas the 
zoom lenses provide depth of field, 

5.3.14 Mirrors Three mirrors au ' their mounting hardware provide 
line of sight access to areas that are otherwise inaccessible, or in 
which a camera would present an unacceptable intrusion. 

In considering the use of mirrors, several concerns arise. First, 
a single mirror reverses the right-left orientation of the video display. 
This can be critical or not, depending upon the nature of the task. 
Second, ikying a mirror reduces the size of the image available to the 
camera, by increasing the relative distance to the image. This generally 
means that the mirror must be mounted in close proximity to the target. 

The mirrors provided with the system are "front-surf aced*^ which 
means that the silvering is on the front rather than the back. This gives 
a truer image with less light loss. It means, however, that the mirror 
surface must not be touched, and must be protected from dirt or scratching, 

5.3.15 Alternative Configurations The fully configured video 
observation system contains a variety of components, not all of which may 
be required by any one particular task. It is possible to assemble the 
system in reduced configurations, suited to the more limited requirements 
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of particular tasks. It Is possible to assemble the system (for Instance) 
with only the number of cameras required by the task at hand^ for moni- 
toring only (without recorders) ^ or without the audio or Intercom cap- 
abilities. 

Partial Console . Figure 2 Illustrates the partial console which 
was actually applied during system field tests. This configuration 
Is highly effective for applications In which one or two camera 
Inputs are required (using cameras 3 and 4) , and can feasibly use 
four camera Inputs (cameras 1 through 4) . 

Cameras . Cameras 5 through 8, which are accessed through the SEQ, 
cannot be connected. 

SEQ . No automatic sequential monitoring Is possible. 
Intercom. The Intercom Is not available. 

Monitors . Cameras 1 and 2, If used, cannot be monitored directly, 
nor can the SEG displays. Those outputs can be seen only by 
switching them to a VTR and observing them on the VTR monitor^ 

Minimum Configurations . The minimum configuration possible Is 
defined by Bay 2 with one camera, either camera 3 or 4, used only 
In monitor mode. Bay 2 must be employed because It contains the 
synchronization generator, and is the point of entrance for camera 
and power cables. 
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SECTION 6.0 SPECIFICATION OF METHOD 

Earlier phases of this project Identified an optimal configuration 
for a video system to support performance testing and student monitoring, 
and built such a system for use In the USAF. The next projected action 
was a field teat to apply that system experimentally In three selected 
USAF technical training environments. Purposes of this field test were 
to verify the system mechanically and functionally, to acquire experience 
on which to base the writing of user instructions, to acquire saiq>le 
recordings, and to test theories of application experimentally • 

this section records the planning for the field tests, to the extent 
that it was pertinent to the experimental findings. 

6«1 PRELIMINARY RATIONALE 

It was Initially intended that three general uses of the video 
system would be examined* These were: 

The training and standardization of test evaluation personnel. 

The conduct of real-time testing and Instruction. 

The collection and evaluation of video performance samples. 

For each of these uses, specific video techniques were to be applied 
and compared in the context of different training/ testing environments. 
These are addressed in the subsc;quent sections of this report. 

6.1.1 Training and Standardization of Test Rates The content 
validity of performance tests is generally recognized and accepted, since 
the relationship of each tv'St task to Job perfonunce can be demonstrated 
by Inspection. The reliability of such evaluations, however, is not so 
readily apparent when the Judgement of human raters must be used. Such 
Judgements are avoided to a large extent by using real outputs or products 
as measures of performance. Measures of performance such as restoration * ^ 
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of a faulty Item of equipment to operational condition leave little room 
for subjective Judgement. Such criteria, however, are not always avail-* 
able, appropriate or sufficient. They may not provide an adequate 
normative basis for personnel actions, or they may provide Insufficient 
training feedback Information, or It may be Impossible to apply the 
ultimate system criteria In the test environment. Thus, while system 
outputs are the most desirable performance criteria, it is not always 
possible to employ them. Instead, information may have to be collected 
on the "processes" the test subject uses. Doing so provides more grading 
points, more training feedback Information, and mre normative data for 
use in personnel selection. 

But using process data may require subjective evaluations « Present 
methods available to control rater reliability include training raters 
on the evaluation criteria, using standard rating forms, spot«>checklng 
rater performance. What is missing in these techniques is a COOBBOnft 
standardized stimulus field (performance) to which all raters can responc 
and which can serve as a baseline. The absence of such a standard pre-- 
vents accurate assessment of the nature and amount of variability within 
any group of raters, and make effective remedial action to improve 
reliability difficult. One application of a video tape system is its 
use to overcome this difficulty. 

To do this several things must be accomplished. First, a set of 
standardized performance tapes must be developed which depict criterion 
performances and quantified measurement points. Standard values have 
to be developed for the measures, and rater personnel must be trained 
in their application. Once this is done, the reliability of a rating 
program can be assessed by having personnel rate standard taped perfor-^ 
mances, and comparing their evaluations. 

Standards are generally derived from the concenstis of expert 
Judgement, but the best source is the system itself. In other words, 
the operation which uses th^ outputs of the subject task can ideally 
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determine the rate, the nature of the product, and the quality levels 
required for satisfactory performance. There are techniques for de«* 
riving such standards, but they are often not practical in training 
evaluation. That means that we are usually dependent on expert Judge- 
ment. 

In deriving task performance standards using expert personnel, it 
is important ^to focus on standards io^osed by the system, as opposed 
to personal ones. A common tendency of content experts is to overrate 
the importance of minor performance elements. The test developer, by 
questioning and documenting the validity of the expert's standards, 
can increase the relevance of the standards imposed, without going to 
a full scale system analysis. 

In performance testing, the most desirable form of criterion is 
one that subsumes all component performance requirements and represents, 
in one criterion performance, the correct and integrated performance of 
all dtib-elements. When such a criterion is used the Intricate scoring 
of sub-elements is acconqpllshed automatically. 

Sometimes the use of such a criterion is not feasible. For example, 
the ultimate criterion for successful performance of a ltd) ri cation task 
might be that the consonants in question do not fail due to improper 
lubrication over the succeeding 100 hours of use. There are obvious 
restrictions against employing such a criterion — time, safety, and 
cost, to mention a few. When such situations are encotmtered, it is 
necessary to substitute evalutions of the process by which the criterion 
is accomplished and to define sub-products which result from that process, 
and which can be evaluated and summated to give a proximate .iieasure of 
criterion achievement. 

When this i9 necessary it is very easy to begin introducing sub-* 
Jective Jtulgements about the process. Judgements which may or may x{ot 
be valid. These must be evaluated to ensure that the role of such 
Juugements is minimized and that each is in fact relevant. In the 
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lubrication process, for exanple, the subject M7 hsve to be evaluated 
on the snoothness of the la^er of grease that has been applied. Like* 
vise In soldering, the appearance (dull, shiny, etc.) of the eolder 
may be pointed out by experts as a proper clue to the adequacy of the 
solder Joint. Without Judging the relevance of these particular 
measures. It Is this type of measure that should be carefully examined. 
Once such subjective Judgements are Introduced, the reliability of the 
overall evaluations will be reduced. 

As an alternative to judgements vfaich subsume sub*-elements of the 
task. It Is sometimes possible to Identify sub-products In the task 
Which can be separately evaluated to give a cosmos Ite evaluation. For 
exaisple, the soldering task can be broken Into sub*-elements to generate 
objective measurement points. These elements Include coiq>onent Identi- 
fication, consonant removal, replacement Installation, determination of 
polarity, choice of solder, choice of soldering Iron size, use of heat 
sinks » and economy of solder used. Each of these sub-elements can noir 
be assigned an Independent quantitative value against which to be 
evaluated. Some elements may be critical; they would be assigned a 
straight right /wrong dichotomy* Fart selection (for example) may be 
such an Item. A man either selects the right coiq>onent or the wrong 
one. If It Is wrong It may be sufficiently critical to fall him on the 
total task. Regardless of how well a man does everything else. If he 
Installs the wrong component there Is no way for the criterion task 
to be successful. Such a decision would be dependent upon the purpose 
of the test. For remedial purposes, It Is useful to know which element 
has failed, so that accurate corrective steps can be taken; for other 
purposes It may be more Important to know whether the full criterion 
performance can be satisfactorily performed. 

The first step In quantifying job task performance for evaluation 
Is to Identify the elements that make up the task. By so doing a 



95 



go, tan wwwLt 



basis Is established for moving avay from a judgemental evaliiatlon which 
cannot be analyzed for comparative purposes^ and toward an evaluation 
which will provide quantitative benchmarks* 

The validity of a job saiq>le evaluation Is dependent on correla^ 
tlon of that evaluation with performance which meets job specifications « 
This validity can be traced out to the user of the product and ulti- 
mately to the readiness of the unit which Incorporates the product Into 
Its operation. Such a tracing procedure Is difficulty costly and time 
consiamlng to execute. More often a proximate criterion must be used 
to short cut this lengthy process. The shortcut Is r;epresented by 
the judgement of some Individual ^ often a supervisor or Instructor ^ 
who presumably knows the specification of the product which make it 
support the operation properly. 

The problem in using this proximate criterion in preference to the 
more distal one is that people^ even supervisors ^ seldom agree. There 
are many reasons for this disagreement; biases of one type or another, 
failure to observe carefully, lack of knowledge, or a nundber of other 
factors. Still for practical purposes judgement by experts is the 
feasible point at which to start. If procedures can be developed to 
reduce differences of opinion, and to resolve the reasons for dispar- 
ity of Judgement, then a useful method for making reliable and valid 
measurements of performance can be attained. 

Let us examine how this process might be accomplished: 

The starting point is a performance recorded on video tape. Sev- 
eral experts are asked to rate this performance. 

The raters are then asked to be explicit about the basis of their 
judgement. 

The reasons one rater gives are compared to others, either in 
private discussions or in a group. Some resolution of differences of 
opinion is expected from this process. 
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To the extent that dlfferencea of opinion appeery the experlsentera 
analyse the consequences upon an actual operation ^ of the perfoxnance 
being judged. This process of analysis will presumably resolve vost 
reaaining differences of opinion. 

The result is a mejthodoiogy for evaluating Job sample performance 
on video tape. To be complete for any task it must prescribe hov the 
camera will be placed and vhat data are to be observed by observers. 
The procedure can be incorporated in a check list. 

The next step is to make new tapes ^ have them rated by the same 
experts t and then introduce new esqpert ^^aters and have them make ratings 
using the check list. To the extent tl ratings obtained in this way 
are reliable ^ their validity can be reasonably assumed. 

Jet Mechanic Testing Application The rationale just outlined 
could presumably be applied in each of the three projected test environ*** 
ments, the first of which was jet mechanic training. Here the point of 
departure for task quantification was presumed to be defined test tasks 
for Block V of the jet mechanics course. While these tasks had not been 
subjected to a formal validation as to their job criterion orientation^ 
they coi^tained sufficient face and content validity to suggest their 
appropriateness for this project. The types of tasks that were repre- 
sented in tae subject tests fell into five general categories: 

Mechanical Assembly 

Inspection 

Checkout 

Servicing 

^Administration 

The mechanical assembly category included component removal and 
replacement and electrical/mechanical adjustment. In this task 
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electrlcal/nechanlcal connections were made and unmade, parts replaced, 
and adjiistments made In accordance with ptibllshed or other standards. 

Inspection Included tasks that required detecting flaws or other 
conditions requiring remedial action. It denoted an unordered, but 
not random activity, structured but not sequence-dependent. 

Checkout activities were those which consisted of a systematic 
checking of a system or sub-sysi^m, submitting It to a defined, sequence- 
oriented procedure. For example, the check out of a lighting system re- 
quired following a check list of switch operations. 

Servicing tasks Included POL servicing, and such preventive 
maintenance functions as cleaning, tightening, or otherwise maintain- 
ing equipment In good working order. 

Administrative tasks lnclu(fed the filling out of forms, reports, 
and records associated with maintenance tasks. Such tasks, of course, 
resulted In a written record which could be processed (graded, etc.) 
In a conventional manner. 

Each of these main categories of tasks presented sets of charac- 
teristics that could be analyzed In terms of task quantification possi- 
bilities. A mechanical assembly task might be broken down as shown 
In Table 5. 

Such a breakdown Identifies scoring elements for any given test 
task. The next thing Is to review these elements with experts to 
Insure that they are complete and accurate, and then to assign values 
to them for evaluation purposes. Meaningful Is defined as a grading 
scheme that can be applied objectively, and that weighs the elements 
in their relative crltlcality to task performance. For the first 
action shown in Table 5, "unbutton aircraft section", proper tool 
usage must be defined and its limits established. If a screwdriver 
is the proper tool, is the size of the screwdriver critical? A 
required precaution is to avoid using scoring criteria simply be- 
cause they are convenient and available. If the size of screwdriver 
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TABLE 5. TASK BBEAKDOWN ^ MECHANICAL ASSEMBLY TASK 



Flight Control Rraoval mad Keplaceaent 



Action 



Scoring Criteria 



Unbutton aircraft section 



Locate specified coiiponent 



Proper tool usage 
Proper panel removal 

Proper location and identic- 
fication 



Renove blocking components 
to gain access to target 
component 



Remove target component 



Kig» adjust, or otherwise 
prepare replacement 
component 

Install new component 



Reassemble blocking parts 



Button aircraft section 



Proper blocking con^onents 
removed, no excess 
Proper tool usage 
Proper technique 

Proper tool usage 
Proper sequence 

Proper replacement selected 
Proper adjustment/preparation 



Proper sequence 
Proper tools 
Proper direction 
Proper safety wiring 

Proper sequence 
Proper tools 
Proper direction 
Proper safety wiring 

Proper tools 
Proper installation 
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used Is a point of little overall liq>act on perfomance, It should be 
Ignored. But If the subject uses vice-grip pliers where a socket 
wrench Is required, such an error ml^t be of significant consequence. 
Through careful analysis, then, objective aeaa^es can be Identified 
that discriminate on critical parameters between acceptable and unac- 
ceptable performance. This type of analysis must be conducted jointly 
by a behavioral analyst and content experts; In thl9 project, analysts 
were to use a new analytical tool - video tapes of actual performance 
which would serve as a constant, repeatable stlmultis field for their 
common focus. 

Power Lineman Pretesting Application The possibility of developing 
quantifiable test evaluation materials was also to be examined In the 
power lineman pretesting application. Task elements to be examined In 
this area were those Included In pole climbing agility used as a 
predictor of student success In training. The decision of an evaluator 
to accept or reject a candidate for training was made on the basis of 
his judgement of the candidate's coordination, strength, confidence, and 
lack of or control of fear of heights is exemplified In his cllnblng 
two poles. At this point the student had had no cllnblng Instruction 
and. In fact, had not yet been accepted for training. Performance defl-* 
dendes that might be overcome through training and practice were to 
be Ignored by the evaluator at this point. The elements of task perfor- 
mance, then, that could be captured on video tape for analysis were: 

Speed 

Coordination (smoothness of climb) 
Placement of hands and feet 
Facial expression 
Strength 

Focus of the climbers attention (I.e., upward, downward, foot 
placement) 

Height reached. 
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Following th« gtneral Approach previously outlined, tepee of e 
nuaber of eubjecte could be oede. Eveluetore could then review the 
tepee to detenlne Which of the tiuggeeted pereaetere were aeeeureble 
froB the tepee. Retlng ecelee epproprlete to eech would be eetebllehed 
and verified with the eveluetore. At tills point other eveluetore would 
be brought in to epply the developed etenderde to tepee of etudent 
perfomance end to determine the relleblllty of the eveluetlon etenderde 
developed. 

The pole clloblng ectlvlty presented an eveluetlon tesk quite 
different from thet of the elrcref t repelr. The letter hed e nuaber 
of objective meesurement polnte evellable, wherees the pole cllnblng 
eveluetlon required e eerlee of subjective judgemente ebout en indivi- 
dual's perfonoence of e elngle task. 

Instructor Training Appllcetlon The third eppllcetlon eree to be 
studied wee inetructor trelnlng. The eveluetlon peremeters evelleble 
here were more numerous then In the power lineman eveluetlon, but just 
es subjective. The specific tesk to be studied wee thet of e student 
Inetructor conducting a dees, before e reel eudlence of ectual students. 

Evaluation parameters for thle teek were elreedy well developed, 
since such eveluatlons had been conducted in person by raters for some 
time. Inetructor trelnlng Is en ectlvlty conmnn to ell schools and 
training centers, so s lot of thought end effort hed been given to 
these evaluations. This resulted In the development of a standerdlzed 
evaluation form which was currently being considered for adoption by 
all Air Force Instructor trelnlng ectlvltles. This form defined e 
considerable nuiri)er of evaluation parameters ; to be determined wes 
which of these would "come through" on video tape,* and which would not. 
In addition new capabilities would be evelleble, such as simultaneous 
split-screen viewing of dess and Instructor. 
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An additional consideration waa that of sampling. One problem was 
the time required for an evaluator to sit through a complete class pre*- 
sentation. If he had to sit through an equally long video tape presen- 
tation, all that would be gained is some scheduling flexibility; the 
evaluator could watch it at his convenience; he could replay any portion 
desired; and he had a useful tool for critiquing the student instructor 
(which is why video is usually used in instructor training). If valid 
evaluations could be made by saiqpling limited segments of an instructor 
presentation, as contrasted with viewing the whole presentation, then 
significant advantages might be realized. 

For those purposes it was proposed to identify, at a gross level, 
whether sufficient information could be captured and interpreted, using 
the designed video system, to warrant further investigation. This would 
be done by again following the general approach of taping materials, 
having experts identify the criterion points and standards, and then 
having other evaluators attempt to apply the standards to taped presen- 
tations . 

6.1.2 Cond i ^ting Real Time Testing and Instruction Another 
capab lity of t'.e video 8yste»n was using it to observe and interact 
with students operating in dispersed locations. The best application in 
which to examine this potential was Jet mechanic testing. In this appli- 
cation there was & reason for students to question the instructor, and 
to receive verbal guidance and instruction. A major parameter to be 
examined in this application was the demand imposed on the instructor's 
span of control by system operation. It was hypothesized that a video' 
system could expand the instructor's effectiveness, since under existing 
conditions he was reqxiired to move from one testing location to another, 
on a random demand basis, as students required evaluation or assistance. 
Having a centralized video network might permit him to observe and 
communicate with the students without moving from one location to 
another. To be examined was whether the system did in fact permit 
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this flexibility, or whether the deaanda of operating the ayatem off 
aet the potential galna. Specific queatlona to be exanlned were: 

Can auffldent vlaual acceaa to atudent performance be pro- 
vided by video caneraa? 

How many almultaneoua dlaplaya can a alngle Inatructor monitor 
effectively? 

Can the ayatem provide adequate reaolutlon for dlacrlmlnatlon 
of atudent performance? 

Can a method of aequentlal 8aiq>llng of atudent actlvltlea be 
effectively monitored by an Inatructor? 

Doea Inatructor control over camera poaltlon (I.e., remote 
control) provide a net gain In effectlveneaa when the added 
operational work load la conaldered? 

What galna In visual acceaa are realized when mxiltlple vlewa 
of an operation are provide ;^? On multiple monltora? Ou 
the aame monitor? 

What la utility of Inter-communlcatlon capability and what la 
the operator load aasodated with xta uae? 

6.1.3 Collecting and Evaiuatlng Video Tape Recordings of Per- 
formance The alternative meana of aaaeaalng atudent performance 
iialng the video system Is to record performances and acore them 
later, rather than In real time. This mode of operation waa to 
be utilized experimentally In all three applications. In the jet 
mechanic area, the need to record was expected to arise as atten- 
tion channels become filled, and the Instructor haa to fall back on 
recording aa a delayed means of observation. In both the pole 
climbing and Instructor training applications, however, the record- 
ed mode: was to be the primary rather than alternative method of 
uae. The specific questions that were to be addressed In the re- 
corded mode evaluation are: 
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How effectively can an Instructor operate a aystem that has the 
recording capability added to the live observation capability? 

What la the relative effectiveness of alternative methods for 
keeping track of the location of recorded sequences for later 
access? 

What Is the relative effectiveness of different methods of re«* 
viewing taped material? 

Does the recorded Image provide sufficient resolution for eval- 
uation purposes? Under what conditions does degradation occur? 

What configurations of recorded operations are most ftmctlonal 
or necessary? 

6.2 FINAL RESEARCH OBJECTIVES 

By the time of the field application tests (Mayi 1973) , plans 
for the test had been further refined, and research objectives were 
reduced to a series of specific questions. Video techniques were to 
be applied experimentally In three selected training areas i and with 
the general objectives of; 

Evaluating the utility of the video system In improving test 
administrator reliability, performance testing , and perfor- 
mance monitor. 

Evaluaflng video technical capabilities of the ffystem, and devel-* 
oping basic video monitoring techniques. 

Evaluating the video system mechanically and electronically. 

Gathering data for user mantialSi and gathering tape recorded 
video samples of student performance. 

System tests were conducted in three training environments; 
jet aircraft mechanic performance testing i power lineman pretest* 
Ingi and technical instructor training. 
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The specific questiono Invaatigated hf these teats are detailed In 
Appendix and Included the principle questions listed folloirlng. 

6.2.1 Utility of Video as a Tool In Monitoring and Heasuyeaent of 
Performance % 

Product and Process Content What product (observable physical 
end product) criteria are critical to evaluatloix of each task? What 
process (activity) criteria? To what extent can those criteria be fully 
monitored through ^ or recorded by, the video system? What Is gained or 
lost by using the system, as compared to direct observation or con^ 
ventlonal measurement techniques? 

Student/Evaluator Feedback What effect does use of the video 
system have on the speed, effectiveness and frequency of remediation? 

Time What gain or loss of time results from using video? 

Operator Load What loads are imposed by subsystems of the video 
system on the time, attention, and physical capabilities of the Instruct- 
tor? What are the costs and benefits of using those sub«»systems, as 
compared to conventional observations? What loads are Imposed by: 

Monitors? 

.>, >V^ Sequential switch? 

Special effects generator? 

Remote pan/ tilt? 

Remote zoom? 

Remote focus and iris? 

Audio monitor-record? 

Intercom? 

Record/replay? 

Tape threading and handling? 
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Changing recorders? 
Switching? 

6.2.2 Videotechnical Capabilities 

Video Feasibility Is it technically feasible to monitor or re- 
cord critical (criterion) elements of specific tasks using the video 
system? Is camera access possible? How many cameras are required to 
monitor /ill significant product features of any task? To monitor task 
performance? What limitations are imposed by lighting? By video 
resolution "of the system? 

Supporting Audio Are supporting audio systems xiseful or required 
for any particular task? Audio monitor or record? Intercom? 

Subsystem Capabilities What are the uses and limitations in rela- 
tion to any specific task oft 

The sequential switch? 

The special effects generator? 

The remote zoom control? 

The remote focxis and iris control? 

The remote focus and iris controls? 

The mirrors? 

Recording and Replay Is it technically feasible to record and 
replay critical features of tasks or task performance? What are the 
capabilities or limitations of the remote and mechanically controlled 
recorders? Of slowed, speeded and stop-frame capabilities? What 
problems occur in logging and relocating recorded information? 

6.2.3 Mechanical and Electronic Characteristics 

Durability How durable is the system? What features or limita- 
tions ill durability of the system or components were noted as a result 
of shipment, reassembly, and movement to successive test areas? 
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Suifblllty How well luited is the physical configuration to its 
intended applications? How difficult is it to asseoble and use? How 
well is it fitted to the human user? What physical or electronic fea- 
tures of the system might be improved in any future redesign? 

6.3 SELECTION OF TASKS 

Three general areas of technical training had been selected earlier 
as likely to provide optimum conditions for field testing of the video 
system and as meeting the experimental objectives outlined in Section 
6.2 These areas were: 

Phase tests, performed on a trainer aircraft, )iy Jet aircraft 
mechanic trainees. 

Pole climbing pretests, administered to airmen who were candidates 
for power linemen training. 

Live classroom training of technical instructors. 

All selected areas were at Sheppard AFB, Texas. Some changes in 
circumstances occurred between the time those task areas were chosen 
and the time of the field tests. Most significantly i reduction In 
student loads resulted In changes In scheduling which limited the 
opportunity of URS/Matrlx personnel to observe and monitor pole 
cllnblng and technical Instructor performances. 

6.3.1 Jet Aircraft Mechanic Area ^ Selection of Tasks On 
arrival at the test slte^ URS/Matrlx personnel reviewed current stu^ 
dent testing procedures used on the F--100 Aircraft Maintenance Train*- 
er (and associated training mockups) ^ to select subtasks for video 
study. Thirteen (13) subtasks were selected Initially^ on the basis 
of their potential tot 

Explore video techniques and to define limitations of the video 
system. 

Exercise different configurations and sub«»sy8tems. 
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Identify appllcatlona In training and testing. 

Subtasks initially selected are listed in Table 6, and their phys- 
ical locations are shown on Figure 11, On two subsequent days, trainees 
were observed performing the listed subtasks In testing sessions, and 
at that time 7 tasks were eliminated from further study (observations 
follow below). Task numbers are those used in Table 6, on Figure 11, 
and on subsequent figures. 

Task 1 - Aileron Bungee This task, under the right wing, was sel- 
ected for further study and is treated in detail by Section 7.1. 

V 

Task 2 - Wing Mooring Actually two very similar tasks, one under 
each wing, are described by the same test item and T.O. reference. 
This task was selected for further study and is treated in detail in 
Section 7.2. 

Task 3 - Chock Wheels 

Task Description ; This task required wooden chocks to be placed on 
each side of one gear wheel, and ties to be inserted in the chocks 
before mooring the wing. 

Test Criteria : The critical point was completion of a four step 
task - two chocks and two ties. 

Observations ; The task lent Itself readily to observation through 
a central video monitor. The chocks were yellow, easy to discrim- 
inate on monochrome video, and the product driteria were gross 
details which showed well on the monitors, even in the poor light- 
ing under the right wing. Nevertheless the task was^ eliminated 
from further study because: 

Students performed it readily with no observed failures, and 
it was experimentally uninteresting. 

Video technical problems were minimal, and not experimentally 
interesting. ' 

Positioning tripod cameras in the area would have impeded 
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TABLE 6. SUBTASKS EXAMINED ~ F-lOO MAINTENANCE AREA 



Location Task/T.O. Reference 

1 Aileron Bungee - Remove and replace right aileron artificial 
feel bmgee. 

T.O. IF-100 D (I)-2-5, Page 5-32, Fig 5-1. 

2 Wing Mooring - Moor right wing with bowline knot. 
T.O. IF-100 D (I) -2-5, Page 5-12, Fig 5-6. 

3 Chock Wheels - Properly chock (R or L) main wheels for mooring. 
T.O. IF-100 C (I)-2-l, Page 5-10, Fig 5-5, step 3. 

4 Gear Door - Inspect landing gear door locks. 
T.O. No reference. 

5 Wheel and Brake - Remove and replace wheel and brake assembly. 
T.O. IF-102A-2-8, Page 1-23, & 8-9, Fig 1-11 and 8-3. 

6 Wheel Bearing - Remove, clean. Inspect, lubricate and replace 
wheel bearing. 

T.O. IF-100 C (I) -2-1, Page 10-9, Fig 10-5. 

7 Lighting - Aircraft lighting check. 

T.O. IF-100 C (I) -2-6, Pages A-13 & A-IA. 

8 Gear Pins - Install gear safety pins for towing. 

T.O IF-100 C (I) -2-1, Pages 5-10, Fig 5-5, step 1 and Fig 
1-7, sheet 1 & 2. 

9 Door Linkage - Remove and replace left shock strut fairing 
door linkage. 

T.O. IF-100 C (I) -2-4, Pages 3-115 & 3-116, Fig 3-37. 

10 Rudder Bungee - Remove and replace rudder artificial bungee. 
T.O. IF-100 D (I) -2-5, Page 6-25, Fig 6-10. 

11 Stabilizer Bolts - Safety wire stabilizer mounting bolts 
and nuts. 

T.O. IF-100 D (I) -2-5, Pages 4-44, Fig 4-8. 

12 Chute Release - Inspect and operational check of drag chute 
release system. 

T.O. IF-100 C (I) -2-2, Page 12-4, Fig 12-7. 

13 Fuel Filter - Remove and replace engine fuel filter. 
T.O. IF-100 C (I)-2-2 , Page 2-113, Fig 2-1. 

110 



student novementt and obstructed video access to the more 
Interesting teaks 1 end 9* This would not be a problem in 
a permanent installation » siace cameras could be mounted 
in or under the wings* 

Task 4 - Cear Poor 
f— 

Task Description ; This was a visual inspection for wear or 
damage to door locks p which were located at each side of the 
aircraft in doors which opened downward from the belly of the 
aircraft 9 back to back, from hinges near the center line* The 
open door panels hung downward from the center line, and were 
inspected from the area under each wing« 

Test Criteria : Criteria for this task were not listed in the 
T«0«; instructor statements concerning criteria were conflicting* 

Observations t The task was eliminated from further study because: 

Video observation would be limited to singly observing that 
a student looks at the door locks* 

The criteria for correct performance was recognition and 
reporting of mechanical defects which were already known to 
the evaluators* There was no role for video in monitoring 
such performance* 

Goals were uncertain, and documentation lacking* 

Task 5 - Wheel and Brake A wheel and brake assembly was mounted 
separately, as a training mocktap, to the right rear of the aircraft 
(Figure 11)* This task was selected for further study, and is treat- 
ed in detail by Section 7*3« 

Task 6 - Wheel Bearing 

Task Description * This task was performed at a bench trainer to 
the left of the training aircraft* The trainee removed a bearing, 
cleaned it using solvent, and repacked it with grease* 
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Teat Criteria ; Critical points were cleaning, recognition of 
Inspection criteria) and repacking In such a aanner as to assure 
that spaces within the roller raceway were filled with grease. 
This discrimination depended on observing hand movements' during 
packing, and observing extrusion of excess grease around the 
rollers and raceway. During the time of the stx^y this test 
was conducted dry, since no solvent or grease was available. 

Observations ; This task was of high Interest because a process 
measure - how the hand and lubricants move in packing the bear- 
ing - was critical. The test was eliminated from further study, 
however, since it was being simulated without lubricants. 

Task 7 - Lighting 

Task Description : This task was performed by observing whether 
aircraft lights did in fact function when the proper switches 
in the cockpit were on. 

Test Criteria : The training aircraft had been set up with sel- 
ected circuits not functioning; the critical measure was the 
trainee's successful identification of those circuits. 

Observations ; As conducted this was a nearly perfect product- 
criterion controlled test. Paper and pencil responses identi- 
fied defective lights; video was not likely to assist scoring 
of this task, and it: was eliminated from further study. 

Task 8 - Gear Pins 

Task Description ; This task required installation of locking pins 
in the gear before attaching the towbar to the nose wheel. 

Test Criterion : Pins were in place. 

Observations ; This task was eliminated from further study for 
the same reasons as the wheel chock task (Task 3) . 

Task 9 - Door Linkage This task, located under the left wing, 
was selected for study and is treated in detail by Section 7.4. 
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T— k 10 - Rudder Bungee Thla task was located on the left face 
of the vertical stabiliser* It was selected for further study^ but 
observations were limited hy the fact that no stiident performed the 
task during the tlise of the URS/Hatrlx field test* Video techniques 
are treated by Section 7* 5* 

Task 11 ^ Stabilizer Bolts This task was located at the root 
of the right horizontal stabilizer. It was scheduled for further • 
studyi but like 10 above was not assigned as a student task during 
the time of URS /Matrix field test* Video techniques are described 
in Section 7.6. 

Task 12 ^ Chute Release This task was located at the lower 
left of the tall assenblyi and was performed from the ground at 
the rear of the aircraft* It was Incltided In recordings made 22 
May for Its videotechnlcal Interest only* Video techniques are 
described In Section 7.7 

Task 13 - Fuel Filter This task was located within the fuse- 
lage of the aircraft. It was selected for further study and Is 
treated In detail by Section 7* 8* 

Miacellaneous Task - Tripod Jack Not Initially identified ^ but 
used later in monitoring experiments , was a task performed using a 
tripod jack* See Figure 3 paragraph 7*9* 

6*3*2 Power Linemen Area Pole Cliablng Pretest This task was 
selected for observation becai^se of high Interest expressed by the 
resident instructor staff of the power linemen course ^ and because 
the task concerned offered unique technical opportunities* 

Description of the Task A principle cause of student elimina-' 
tlons in the power linemen course has been real or claimed fear of 
height I and inability to acquire the coordinations needed to work 
while mounted on a pole. Therefore the school has developed pre-* 
testing procedures designed to screen out those candidates who lack 
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coordination or who exhibit {ear of high places* The pretest Included 
a written questionnaire plus a practical cltioblng test In which candl^ 
dates 9 without prior familiar Izatl on ^ are required to cllnib one pole 
using clliflblng spikes , and one pole using step^^leats mounted to the 
pole* 

Criteria The criterion for selection was the judgement of ex- 
perienced Instructors y as to whether the candidate exhibited coordina- 
tion* confidence* and ability to overcome fear of high places* 

Experimental Outcomes It was hoped that this experimental 
application would: 

Provide technical evaluation of the video system In outdoor use* 

Assist In evaluating potential of the video system for the stan- 
dardization of rating techniques* 

Provide video documentation by which school personnel could review 
their Judgements regarding students who later presented themselves 
for voluntary elimination* claiming fear of heights* 

6*3*3 Instructor Evaluation Application This task was selected 
for the field test because of the high presumed value of video In In- 
structor training. It was assximed that a capability to record the 
student Instructor's performance* simultaneously with reactions of 
his class* could be useful to the Instructor In scoring that perfor- 
mance at a time of greatest convenience* 

Description of the Task A newly .trained technical Instructor 
was assigned practical training* Instructing a real class In an appli- 
ed setting* Classroom activity consisted of an Initial lecture/demon- 
stration* during which students sat as In a standard classroom* followed 
by a laboratory phase during which the students worked In training 
booths which surrounded two sides of the classroom. The task concern- 
ed was an electric power fault Isolation exercise* 
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Criteria Criteria for the Inatructor taak were complex, requir- 
ing applied demonstration of principles of instruction presumably 
learned earlier, and successftil interaction with students in class. 

Experimental Outcomes It was hoped that this experimental appli<% 
cation would: 

Assist in defining the value of recorded video as a tool by which 
student Instructors could review their own performance, and observe 
the effects of that performance on a class. ^ 

Assist in defining the value of video recording for use in post- 
exercise evaluations. 

Provide for evaluation of the audio-record capability. 
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SECTION 7.0 JET AIRCRAFT VIDEO TESTS 



URS/Matrlx personnel received the Video Observation System from 
the builder t shipped it to Sheppard AFB^ and assembled It Initially In 
Its full configuration (Figure 1) In the Jet aircraft maintenance 
testing area. The system was operational In about 48 hours » having 
required 16 man-hours to assemble. Of this time approximately 12 man* 
hours were required for physical handling and unpacking ^ and 4 man*hours 
for plug*ln» testing and adjustment. All subsystems were found to be 
ftilly operational following shipment. 

The equipment performed well. After some experiment^ satisfactory 
video monitoring was achieved for all selected tasks. The equipment 
performed with consistent reliability » in spite of limited access to 
power. A serious difficulty was the interference of glare and high- 
lights ^ caused by the highly reflective aircraft surfaces. Figure 12 
shows the camera layouts used on 16 » 17 and 18 Hay. Figure 13 shows 
camera layouts used on 21 and 22 May. Figures 14 and 15 show the light- 
Ing levels which existed in the training area» and which determined 
video techniques. Figure 16 (page 148) is a cutaway view of the aircraft 
showing the camera^ light erA mirror iised 16 - 21 May to study task i3. 

Following check-out » URS/Matrlx personnel began exploratory use of 
the video system to monitor and record trainee performance in selected 
Jet aircraft mechanic tasks. The target activity was a series of Job 
performance tests » being administered at the conclusion of a block of 
instruction in flight-line airframe maintenance and service. 

A major preliminary objective was to verify that video observation 
could be useful I considering the already well developed scoring system 
in \ise at this pointy and the nature of the tests in progress. These 
block tests were highly developed^ Job-criterion referenced tests « 
which were performed on an F-lOO trainer and associated mock-ups under 
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Figure 12 



- Tasks Selected for Study and Location of Cameras 
16-17 May 1973 
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Figure 13 - Camera Layout and Lighting 
22 May 1973 
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20 FC Incident at horizontal 
or oblique upper surface 

@^fC at vertical surface 

^^■^FC at under surface 

^ (Letter) see note page 
following 
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Flgura 14 - Incident Light at Low Light Condition 
0900 Hours 22 May 1973 
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Figure 14 - Continued: NOTES 

(A) Less than 5 FC. 

(B) Less than 2 FC by ambient light. 300 FC at task when 
using video system lighting shown at Figure 13. 

(C) Less than 5 FC by ambient light. 300-500 FC at task 
when using video system lighting as shown at Figure 13. 

(D) Interior of fuselage. No measurable light. 500 FC 
at task when lighted. 

(E) . Less that 5 FC. 

(F) From 10 FC at floor level to 35 FC at 5 feet up. 

(G) From 10 FC at floor level to 25 FC at 5 feet up. . 

(H) Overhead Incandescent light at this point, 20 feet 
from floor, Is source of ambient lighting. 

CONDITIONS: 0900 houra 2?. May 1973. Sky overcast, 50% 
of light from overhead Incandescent hangar lighting. 
Skylight comes from hangar doors to the xrlght, 
closed. 

NOTATION: All figures represent foot-candles (FC) light 
Incident at surface. 
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Figure ^15 Incident Light at High Light Condition 
1100 Hours 22 May 1973 
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Figure 15 - Continued: NOTES 



(A) All lighting to left and under aircraft Is 
same as In figure lA (low light condition) 

(B) Less than 5 FC 

(C) Ranging from 100 FC at floor to 250 FC 
at 5 feet 

(D) Ranging from 100 FC at floor to 150 FC 
at 5 feet 

CONDITIONS: 1100 hours 22 May 1973. Sky clear, 
hangar doors (to right) partly open. Less 
than 10% of illumination from overhead incan- 
descent lighting. 

NOTATION: All figure represent foot-candles (FC) 
light incident at the surface. 



Figure 15 (Continued) 
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rtallstlc £l«ld conditions. Each test Item consisted of a written task 
instruction which directed an operation or Inspection to be performed, 
and which then was scored objectively on the basis of either: 

Product criteria In the form of a recognisable hardware end 
condition (landing gear locking pins are fully Inserted) , 

or: 

Product criteria In the form of a student *s correct observation 
and report of a recognizable hardware condition (left wing 
clearance light does not function). 

These tests were nearly Ideal objective, criterion referenced 
measures; therefore the process by which end-product criteria were 
achieved did not (In theory) enter into the scoring system. Presumably, 
If a working mechanic could use the Technical Order to complete his 
tasks In the available time, no one cared how he did so. If therefore, 
as presumed, the tests concerned only end-products and not the processes 
by which they were achieved, then the activity of the trainees had rela- 
tively small In^ortance, and since the virtue of video Is to capture 
action, the value of video was In question. The URS/Matrlx study was 
therefore looking partlculary for: 

Points at which process criteria were unconsciously being applied. 

Points at which product criteria did not fully define competent 
performance. 

Points at which video offered economy of time or effort, as com- 
pared to direct observation. 

Points at which safety required active monitoring of performance. 

Points at which the use of product measures might endanger learning 
objectives. 

7.1 TASK 1 - AILERON BUNGEE 

7.1.1 Task Description Access to this bungee was from beneath 
the right wing, just aft of the landing gear, and between the gear strut 
and the wing tank. A panel on the lower wing surface was left off 
permanently (on the trainer) for student access. The bungee is aiv 
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elongated cylinder Into which a metal shaft slides from one end; at 
each end is a collar (one on the outer end of the cylinder and one on 
the shaft) by which the bungee is attached to the aileron control 
system. Visual inspection of the Installed bungee was partly iiiq)eded 
by wing structures and hydraulic lines. 

7.1.2 Test Criteria Critical criteria for verification of per- 
formance included: 

That the bungee was installed with the cylinder end to the 
inboard side. 

That bolts and nuts were inserted from the correct direction. 

7.1.3 Observations Task 1 was a case in which the instructor 
had to expend time to personally walk around the aircraft and to verify 
installation of the bungee in an area difficult to view; video offered 
the possibility of saving some of that time and effort. The task raised 
technical questions as to whether trainee body movements could block 
video access, whether critical small parts could be seen through a video 
system, whether all pertinent action and criterion product points could 
be contained within a video frame, whether sufficient visual contrast 
existed to make the subject matter visible, whether audio communication 
was necessary for task evaluation, and questions regarding which fea- 
tures of the video system were useful in monitoring or recording the 
task. These, and other experimental questions concerning application 

of video techniques to the sub task, are further detailed in Appendix A. 

7.1.4 Video Technique. 17-18 May Initial attempts to monitor 
repair of the aileron bungee employed a camera positioned inboard of 
the aft end of the right wing tank, looking forward and up to the under- 
surface of the wing. The poor light at the task and contrasting high- 
lighting of background objects forward of the aircraft made it 
impossible to achieve an image at the monitor (See Figure 15, Lighting). 
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Lights ware broufl^t onto the task area and tried from several 
angles. In every case» high glare Iron tanki wing and gear surfaces 

blocked out the aonitor image and threatened to damage the vidicon 
tube. Casieras placed aft of the tank proved to be in the way of the 
student performing the task. When they were placed far enough to the 
rear to be out of the vay» the bungee was not visible. 

Finally 9 camera 6 was placed on a lowboy mounting under the edge 
of the fuselage to the left rear of the tank (6A9 Figure 12). Lights 
at the aft end of the tank between landing gear and wheel gave excel-- 
lent resolution of the bungee , although trainee performance was 
frequently obscured by body and hand movements. Criterion points of 
bungee attachment were clearly visible. 

Camera 4 (remotely controlled) was positioned so that it cotild pan 
to the underwing area, permitting observation of both the bungee 
(through camera 6) and of the student installing it (through camera 4). 
Highlights around the wheel assenbly and glare from the tank were con- 
trolled using barndoors and dif using screens on the lights. 

The lowboy mounting proved to be hazardous. The weight of the 
camera^ which is mounted between two of the tripod legs^ placed the 
center of gravity precariously forward. When the leg opposite the 
camera was shortened » the tripod was less likely to be knocked or pulled 
over 9 but still needed to be protected. 

Special Effects Generator (SEG) displays were constructed and an 
optimum configuration achieved in ^;hich the bungee (camera 6 output) 
was seen laterally across the monitor screen with the underwing area 
(camera 4 output) shown on a quartcr**8creen. The full screen showed 
details of the bungee and of tool movements during installation « while 
the quarter screen gave a general view of the student's actions. 

The general view (camera 4) gave no criterion information* It did: 

Make it easier to interpret movements which otherwise were seen as 
disconnected hand and tool motions ^ occasionally blocked by the 
student's head or shoulder. 
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Reveal what the student was doing during the substantial portion 
of his time when he was looking at the bungee without acting, was 
reading the T.O., or otherwise was not visible on camera 6. 

Prevent the Instructor from wondering why the screen was vacant, 
or whether or not someone was active in the work area. 

Ambient hangar temperatures were in the range 70°-80° (Fahrenheit) . 
Students complained of heat from the 600 watt lights. This problem 
would have been more serious later in the year, when nonw.l afternoon 
hangar temperatures exceed 100°. 

Camera 6 was later moved and Installed on a lowboy mounting, to the 
forward side of the wing between gear and tank (6B, Figure 12). The 
near-ground mounting and advantageous angle of the wing allowed a 
clearer view of the bungee with less body Interference. One light, 
placed at the former camera position (6A) , gave adequate illumination 
with virtually no glare, but with occasional blocking by personnel 
movements . 

7.1.5 Video Technique » 20-21 May In further tests conducted 

20 and 21 May, camera 6 was moved to a position by the right gear wheel, 
looking up from the closest floor position at 11 o'clock to the task. 
Lighting was provided from in back of the wheel (see Figure 13) , and 
camera 4 was again used on-call by remote control to provide a general 
view of trainee actions. Slightly improved picture resolution resulted. 
A recording was made on 22 May (see Appendix B, Video Sample Log 6). 
In this camera 6 position, the bolt on the rod end of the bungee 
(inboard) was partially obsciired by hydraulic lines. It was observed 
that correct insertion of that bolt could -be confirmed by observation 
of the position of the trainee's hands as he Inserted the bolt. The 
bolt must be inserted from above, not below. This is a process rather 
than a product observation. 

7.1.6 Instructor Evaluation On 17 May a group of 6 USAF instruc- 
tors conducted testing experimentally, using video access. The instruc- 
tors were seated at the console; one Instructor operated the console as 
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necessary and scored performance, vhlle the remaining five simply scored 
performance as seen on video. Stuldents were Instructed to come to the 
console area when they required guidance, or when the testing required 
the instructor to inspect a part (measure length of linkage, task 9, 
and check tightness of thumbscrews, task 13); otherwise all evaluations 
were made by video monitor access. Instructors were Invited to comment 
on the adequacy and effectiveness of the system. These tests were con- 
ducted without use of the audio intercom. Portions of the test sequence 
were recorded; see Appendix B, Video Sample Log 3. 

Table 7 summarizes this series of experiments. Student activity 
was displayed at the console through a changing sequence of monitars, 
special effects displays and recording techniques, while Instructors 
scored the regularly scheduled block tests on the basis of video infor- 
mation. When it was possible to recognize scoring criteria through the 
video presentation without difficulty, and when all Instructors agreed 
on the scoring, an X on the table Indicates that the video subsystem 
which was then being used was fully acceptable. When the subsystem did 
not present acceptable information, when its use resulted in uncertain 
scoring, or when users made significant comments, a numeral on the table 
refers to an appropriate note. 

7.2 TASK 2 - WING MOORING 

7.2.1 Task Description The mooring task required tieing the 
aircraft from mooring points outboard of the wing tanks, using a rope 
and either a bowline or a square knot. 

7.2.2 Test Criteria The critical observation at the right wing 
was whether or not the student could tie a bowline correctly (as distin- 
guished from other knots). The existing test required tieing the right 
wing with a bowline and the left wing with a square knot. It was the 
bowline task which caused the greater difficulty, although students 
occasionally failed to discriminate a square knot from a granny knot. 
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TABLE 7. EXPERIMENTAL SCORING OP PERFORMANCE TESTS BY 
VIDEO - AILERON BUNGEE TASK 



Subsystem used, 

Number of student subjects 



Acceptability of video Information, 
All Criteria* 



Camera 6B (zoomed to detail) 
Camera 4 (general view) 
3 subjects 

Camera 6B (zoomed to detail) 

2 subjects 

Camera 4 
1 subject 

SEG Display: Camera 4 
quartered on Camera 6B 

3 subjects 

SEG Display: Camera 
4 and 6 (as above) 
Recorded VTR-1 

3 subjects 

SEG Display: Cameras , 
4 and 6 (as above) 
Recorded VTR-1 
Fast playback 

4 subjects 

SEG Display: Cameras 
4 and 6 (as above) 
Recorded VTR-1 
Fast search to last frames; 
view by stop-frame 
7 subjects 



X, 1 
X, 2, 3 
4 

X, 5 



X, 6, 7 



X, 7, 8 



X, 7, 9, 10 



* Notation: X - Criterion was dlscemable on video, and 

instructors agreed on scoring. 
1 - See note. 
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TABLE 7. NOTES 



1. Caaera 6 Is accessed through the sequential switch (SEQ). Thus, 
while this experiment was In progress, the SEQ was set "manual**, 
and the SEQ monitor committed full time. As a result, during the 
time no video access was possible for tasks 8 and 10, which also 
are accessed through the SEQ, neither could caniera 7 be used to 
provide the general view for 'task 9. In any future redesign or 
modification of the system, s«q>plemental switching should be con- 
sidered to directly route these camera outputs (5, 6, 7, 8) to a 
SE6, or to the recorder Inputs. 

2. Since no general view of the area was available. Instructors could 
see only tool and hand movements, and end-product conditions 
(bungee removal, bungee Installed). Subjects spent much of their 
time passively looking at the task, sitting under the wing and 
looking at the T.O. or the removed bungee, or away from the area. 
Instructors were uneasy during the approximately 65% of the time 
when no activity was displayed at the monitor. In a task typically 
requiring 8-15 minutes, less than 3 minutes was required actually 
to remove and replace the bungee; some subjects spent another 3 
minutes In waste or erroneous activity. As Instructors became 
familiar with the procedures. Inability to see the trainee disturbed 
them less, and they were content to score this task by the end con- 
dition viewed at the monitor. For this purpose they required video 
only on two occasions: (1) when the subject needed help (rarely), 
and (2) at completion of the task. 

3. During this experiment, no audio Intercom system was available. 
Later one audio station was Installed In the task.l area, with the 
expectation that scoring that task could be accoaqillshed In ten 
seconds by switching a monitor to camera 6 on call from the student. 
That would have represented a work econosQr for the Instructor, who 
had to walk to the work area, stoop under the wing, and examine the 
bungee approximately 1.5 times per trainee assigned the task. 

A brief attempt to demonstrate this method on 18 Jtine was not 
successful. In spite of Instructions, trainees walked over to the 
Instructors, or had difficulty In using the Intercom. Instructors 
were confused because no good procedure existed by which to recog- 
nize which Intercom station was calling. It Is recommended that: 

Instruction to call In at task completion be written Into test 
documents . 

Calling In at every task conclusion be practiced, to reduce 
the milling of trainees about the area and to ensure that 
operation of the call system Is learned. 
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TABLE 1. NOTES (CONT^D,) 



Consideration be given , In any future redesign or modification 
of the system, to a buzzer«*and*-llght call system which will 
Identify the station calling. 

4. It was not possible to see criterion product points using this 
camera, and no process criteria Were Identifiable In the task. 

5. In the SEG display the bungee appeared laterally across the monitor 
face from upper right to lower left, with the general (camera A) 
view Inserted at upper left to occupy less than 20Z of the tube 
face. Instructors preferred this presentation to all others used. 

6. The fact that no action Is occurring on camera during most of the 
viewing time becomes even more obvious when the performancfis are 
scored from recordings, after stxidents have left the area. 

7. This performance recorded; see Appendix B, Video Sample Log 3. 

8. No loss of Information resulted from speeded replay, although hand 
and tool movements were blurred. 

9. It was clear that the task could be fully scored by viewing the 
end-product on a single static video frame. No process criteria 
were Identified. 

10. These are the same subjects and tape as those In the two entries 

Immediately above. The tape was replayed to perform the evaluation. 
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Correct tension and alack In the line VM alto iaportant, but raalita 
of the test was Impaired in this respect by the fact that the line was 
secured, not to a floor bolt, but to an eyebolt seated in a light, 
moveable wood block. 



7.2.3 Observations This task was currently scored by an instruc- 
tor who had to move to within view of, and closely observe the knot. 
The procedure was inefficient. Many students (most of those observed) 
had serious difficulty in tieing a bowline, and spent much time in 
fruitless experiment; they then frequently presented an incorrect knot 
for evaluation, and required substantial remediation and several attempts 
before succeeding. It is doubtful that learning occurred, and certain 
that the testing procedure did not demonstrate coiiq>etence. Several 
instances were observed in which an incorrectly tied knot was scored 
"correct", when seen cursorily at a distance. This would appear to be 
a point at which video might: 

Provide early clues, feedback and remediation to prevent practice 
of error behavior. 

Reduce instructor movement. 

Speed trainee performance. 

Provide speedy and precise inspection of product, and prevent 
reinforcement of error. 



7.2.4 Video Technique Mooring tasks were readily observable by 
panning and zooming camera 4 to either wing area. At the right wing, 
ambient lighting was fully satisfactory. At the left wing, artificial 
lighting would have been required if actual evaluation were attempted. 
Evaluations during the study were limited to the right wing. Incident 
light at the best plane of illumination normal to the axis of the ropes 
was (sunny condition) 65 footcandles right, 20 footcandles left; see 
lighting charts. Figures 14 and 15. 
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7.2.5 Split Screen Djjplay A SEG-2 display was constructed In 
which the monitor screen was spilt vertically and shared with task 1, 
the aileron bungee. Since it was necessary to see only the rope to 
verify correct mooring, and since that required only a narrow vertical 
slice of the screen, the SEG display was constructed with the rope 
occupying only the right 1/4 of the screen and with the bungee dis- 
placed obliquely across the remaining 3/4. Criterion features of both 
tasks were adequately visible. 



7.3 TASK 5 - WHEEL BRAKE TRAINER 



7«3«1 Task Description A wheel and brake assembly was mounted 
separately as a mock-up trainer, which at the time of this study was 
located to the rear and right of the aircraft. The student was required 
to remove the wheel, then the brake asseiil)ly, and to replace them both 
on the hub correctly. 



7.3.2 Test Criteria Formally recognized tost criteria were: 

Criterion 1 - Reinstalling the wheel with Its Inboard and outboard 
sides correctly positioned. 

Criterion 2 - Proper position of a drain. 

Criterion 3 - Alignment of kcyways and splines. 

Criterion 4 - Connection of an air hose. 

Criterion 5 - Propcv seating of a wheel nut. 



7.3.3 Obs rvatlons Of the listed criteria, nuinber 1 (wheel 
position) could be verified by an observer from either the back or front 
of the trainer. Criteria 2, 3, and 4 were visible only from the back 
(strut) side. Criterion 5 was visible only from the front. The task 
raised Interesting vldeotechnlcal and performance measurement problems, 
concerning the number of cameras required to collect all needed Infor- 
mation, the possibility of Integrating that Information Into a single 
signal using special ef fleets, and qu:estlons of the relative necessity of 
product and process measures. 
O 132 
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It appeared that the 5 product criteria listed above were not fully 
adequate to assess a trainee's knowledge of the task, since it was 
possible to assenbU the wheel and brake c^^rrectly by accident. There 
was a 50 percent chance of mounting it right side inboard, 20 percent 
chance of properly positioning the drain, and roughly a 15 percent 
phance of proper alignment of splines. A possible process measurement 
point was observing whether the student looks over the wheel while 
sliding it on the drum, which he must do to see the splines. (See 
further paragraph 7.3.7.) 

7.3.4 Video Techn ique. 16-18 Mav The diagram at 5 on Figures 12 
and 13 represents the trainer, which consisted of a stand on which was 
mounted a wheel strut, wheel and brake asseid>ly. 

Because both sides of the wheel had to be examined to recognize 
criterion performance, cameras 1 and A were Initially set up tg see 
their respective sides of the wheel (Figure 12) . 

Camera 1 was placed at azimuth 11 o'clock from the trainer, dis- 
tance 12 feet, and zoomed to frame the wheel plus approximately 18 
Inches each side and 3 feet above. Illumination was anfclent light from 
the hangar door (behind the camera) only. A highly satisfactory signal 
was presented at the monitor, using maximum Iris opening. 

Camera 4 was positioned high at 7 o'clock and app oxlmately 12 
feet distance, framing (Initially) the ^ame area as camera 1 from the 
opposite side of the trainer. Lighting from the hangar doors (facing 
the camera) was more Intense than lighting on the work surface, and 
caused wash-out Images at low iris openings, or glare which blocked out 
working detail at high openings. Using the remote iris control, it was 
possible to achieve adequate resolution of the wheel and of trainee 
actions, but a poor picture resulted. Iris settings required frequent 
adjustment due to changes in light angle with time of the day; the 
remote capability was valuable in that regard. A 600 watt incandescent 
light was positioned at 5 o'clock azimuth, 8 feet from the wheel, 
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lighting the dark side so that a high quality picture was produced at 
camera 4« In spite of reduced Iris openings tislng the light , at the 
end of the working day a persistent after-*lmage of the hangar door had 
been formed on the vldlcon screen , an Image which lasted for about 40 
minutes after the camera had been trained on a different target. 

Critical details of the wheel discernible from the camera 4 side 
were only two: correct position of Inboard and outboard sides » and 
seating of the axle hex nut. Therefore, camera 4 was later zoomed In, 
and refocused to frame only the hub, the nut, and Its Immediate area of 
approximately 16 Inches square. In this setting the highlight from the 
hangar door did not Interfere seriously with contrast and resolution, 
and adequate pictures were possible without artificial lights. 

Still later, camera 2 was detached from another task (2A, Figure 
12) and positioned low (18 Inches above floor) at near 12 o'clock 
azimuth (2B, Figure 12). It was used to monitor details of the wheel 
and brake face, while camera 1 monitored general trainee movements and 
camera 4 monitored the hub and nut. Finally, camera 2 was zoomed in 
further to frame only the lower right 1/3 of the wheel. This Increased 
the clarity of detail and still Included all criterion points on the 
monitor screen. Recordings of student performance were made In the 
course of this experiment; see Appendix B, Video Sample Log 2. Later 
roles of these cameras were reversed: Camera 2 gave the general view, 
camera 1 was zoomed to detail. In summary: 

Camera 1 monitored the strut side of the trainer, seeing the wheel 
plus surrounding activity from the light side. This camera 
normally faced the trainee, from the opposite side of the trainer, 
as he worked. When the wheel was fully momted, the trainee's 
body was partially obscured by the wheel. 

Camera 2 monitored details of the wheel from the same side. 

Camera 4 monitored criterion 5, the wheal nut and hub, from the 
opposite, dark side of the wheel. When the trainee was working, 
he normally had his back to i camera, obscuring the wheel nut 
about 50% of the time. 

Camera 4 was used at the same time by remote pan/ tilt to cover 
tasks 1, 2, 5, and 11. 
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Using coMra 2 to provide a general display of the trainer and of 

trainee aoveiesnti a SEG^l display was psoduced using output of camera 1 
to display details of spline alignment ^ wheel position and hose attach- 
ment, with output of camera 4 inserted (quartered) In the upper right 
and zoomed in to show detail of the wheel nut only. This display was 
highly effective. All criterion points were identifiable from the SEG 
display* 

A problem was Identified in xxse of the SEG; When this display was 
attempted using asu lent lighting, adequate pictures were seen at the 
monitors for both cameras 1 and 4, but when those signals were combined 
on the SEG, the high signal level from camera 1 tended to control the 
AVC level, and blocked the signal from camera 4, which framed the less 
well lighted side of the wheel assembly* The result was that, in any 
display in which the horizontal scan passed from camera 1 to camera 4 
(all quartered or vertically split displays) , the camera 4 segment was 
darkened and its resolution badly degraded* A light was placed at 
azimuth 8 o'clock (Figure 12), 8 feet from the wheel hub, and resulted 
in an excellent SEG display, in which the small shadows and highlights 
from the unshaded bulb brought details of the hub and nut sharply into 
definition in spite of the small area (less than 20% of screen) of the 
quartered camera 4 SEG display* 

A SEG-1 display was generated using a horizontally divided screen, 
on which camera 1 presented, at the bottom, the lower half only of the 
wheel assembly* The output of SE&-2 was used to Insert above, in the 
left qtiarter, the wheel nut (camera 4) and in the right quarter the 
general view from camera 2* This display was generally satisfactory, 
although the reduced image size of the camera 2 display, and cascading 
of the signal, reduced the resolution of detail from camera 2. more 
serious deficiency was that, in some Instances, it was not possible to 
see the hose attachment* 

A SEG^l display was generated in which camera 1 presented the lower 
half of the wheel (as above), and camera 4 output, including the wheel 
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nut, was presented on the upper half of the SEG monitor screen. This 
display was technically successful to the extent tt^t it made it 
possible to present both sides of the wheel in a single disp4.ay without 
using artificial light. The blocking effect noted earlier did not 
occur when cameras were combined on the SEG split horizontally (top and 
bottom). This display was marginally defective because (again) the 
hose connection occasionally was not vi8i1>le« An attempt was made to 
use the remote zoom capability of camera 4 to provide, alternately, a 
detailed view of the wheel nut and a general view of the trainer and 
trainee actions. While it was possible to do so, it proved impractical. 
Under certain (midday) lighting conditions it was necessary to reset 
iris openings after each change of zoom. In any case, it proved diffi- 
cult to operate the zoom rapidly enough to respond to the alternating 
need for detailed and panoramic information. 

7.3.5 Video Techniques, 21-22 May Further tests were conducted 
21 and 22 May. Camera layouts for that test are illustrated on Figure 
13, and differed from earlier layouts only in that camera 2 had been 
removed to another task. Camera 1 was zoomed to frame approximately 
the lower 3/4 of the wheel and brake assembly, showing all possible 
positions of the hose line and other criterion points visible from the 
strut side. Camera 4 was moved slightly to the left (up in diagram, 
clockwise in relation to the task) so that it could frame the entire 
trainer but avoid the glazed area of the hangar doors. In morning light 
there was some glare from the hangar floor, which caused a washed-out 
image and unclear presentation of the wheel nut. This could be cor- 
rected either by using supplemental lighting or by remotely zooming to 
verify seating of the nut. 

7.3.6 Instructor Evaluations Evaluations by the instructors on 
17 and 18 May produced the following findings; 

Additional Criteria The product criteria formally identified 
(7.3.1) proved to be incomplete, and additional criteria were discovered 
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uhlch^ although they had not been documented, were actually being used 
in acorlng the task* Mew criteria were: 

Order of tasks: The order of taska directed by the T«0« required 
that the pnetmatlc line be connected after the brake BBBevtiy was 
installed, but before the wheel waa mounted. That sequence was 
important for flight safety ^ but could not be verified by inspect-* 
ing the completed task. Existing practice made it a matter of 
chance, or of instructor habit, as to whether an intermediate 
check was performed - to make such a check required the instructor 
to walk to the back of the trainer ^ and most failures to meet 
this criterion went unnoticed. The video test, however, made 
access to the rear of the trainer readily available, and differ-- 
ences in the scoring practices of the instructors became obvious. 

Spline matching: The possibility that the ^eel might be installed 
with splines and keyways correctly aligned by accident has been 
noted. To mount the wheel correctly (and safely) the mechanic had 
to look over the wheel while sliding it on, and rotate the wheel 
to match the splines. Confirming this behavior required ^ process 
observation. 

Wheel seating: One subject was observed to fail to seat the wheel 
completely over the brake assembly. In this position, all visual 
check points appeared correct to a casual inspection through the 
video monitors, although the defect would have been obvious on 
direct inspection. Placement of cameras so as to view the work 
more obliquely, or use of strong oblique lighting, would have made 
this criterion more readily visible « 

The consequence of identifying these additional criteria was to 
increase the number of criteria to 8, of which 5 were formal criteria 
previously listed: 



Criterion 


1. 


Wheel placement 


(product] 


Criterion 


2. 


Drain position 


(product] 


Criterion 


3. 


Spline alignment 


(product] 


Criterion 


4. 


Pneumatic hose 


(product] 


Criterion 


5. 


Wheel nut seating 


(product] 


Criterion 


6. 


(new) Order of tasks 


(process] 


Criterion 


7. 


(new) Spline matching 


(process] 


Criterion 


8. 


(new) Wheel seating 


(product] 



137 



BEST COPT mmii 



Experimental Scoring Table 8^ ^Ich follows, sunmrlzes results 
of experimental scoring of the v^o.el*<brake task. In tezns of the sspar* 
ate performance and product criteria. Notes Include pertinent connsnts 
by the participating USAP Instructors. Portions of this test were 
recorded; see Appendix B, Video Sample Log 2. 

7.4 TASK 9 - DOOR LINKAGE 

7.A.1 Task Description This task was located under the left 
wing, inboard of the tank pylon, where a small faring door was attached 
by a linkage the length of which could be varied by turning a threaded 
coupling. In the gear-down aircraft, the linkage was below and outside 
the wing surface. It was obstructed to some degree, from every angle, 
by the fairing door or other structures. 

7.4.2 Test Criteria Test criteria were: 

Properly adjusted length of the linkage, measured by a ruler. 
Attachment of the proper ends to proper points. 
Insertion of a pin (one end) with head up. 
Insertion of a bolt (other end) with head up. 

7.4.3 Observations This task was of technical Interest because 

of the difficulty of visual access, physical smallness of critical parts, 
and extremely poor lighting of the area under the left wing (less than 
2 candle power at task, see Figure 14). 

7.4.4 Video Technique. 16-18 May Initial attempts were made to 
observe removal and replacement of the door linkage from the front end 
of the wing tank near the leading edge of the wing. This area was quite 
dark; ambient lighting at the task (point A in Figure 15) was less than 
2 footcandles. Light was placed in various positions around the tank, 
the fuselage and in front of the wing. In every case, severe highlights 
from the aluminum surfaces of the aircraft tended to block out monitor 
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imS I P imUM I A L SCORING OF PEKTORMAliCE TESTS 

ir nrao — vheel-braxe task 





Criterion scored 




1 


2 


3 


4 


5 


6 


7 


8 


fir* 1 gMMTAl irlMT 

CflWf • 4 sotmi 
2 M*i«et« 


X 


X 


X 


X 


X 


X 


X 


1 


GMnra 1 toomi 


X 


X 


X 


X 


X 


X 


X 


2 


CiMH 4 Ml call rcapttt 
1 M*i«et 


X 


4 


4 


4 


5 


X 


6 


1 


Caanra 1 
1 M*i«et 


X 


4 


4 


4 


7 


X 


6 


1 


SK Mffplof (A) Cawra 4 
^MVttfTcdl on Cmmrm 2; 
Cmmtm 1 oo Bonltor 
2 rabjccts 


X 


X 


X 


X 


9 


X 


X 


1 


8K Display (B) Caaera 
2 4 4 quartered at top, 
Caaera 1 at bottoa 
1 aubject 


X 


X 


X 


10 


11 


X 


X 


1 


816 Dlaplay (C) 
Caaera 4 50Z super- 
lapoaed on Canera 2 
1 subject 


X 


X 


X 


10 


X 


X 


12 


1 


SE6 Dlaplay (A) Recorded 
1 subject 


13 


X 


X 


X 


X 


12 


X 


1 


(continued) 



















* Notation: Z - Criterion was dlacemable on video » and Ins true 

tors agreed on scoring* 
1 - See note. 
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1 


2 


3 


4 


5 


6 


7 


8 


SE6 Display (A) Recorded 
selectively 
1 subject 


14 


14 


14 


14 


14 


12 


14 


1 


SEG Display (A) Recorded 
at slow tape speed 
(nomal) action 
1 subject 


15 


X 


X 


X 


X 


12 


X 


1 


SEG Display (A) Recorded 
tilth speeded replay 
1 subject 


16 


X 


X 


X 


X 


12 


X 


1 


SEG Display (A) Recorded 
and replayed using 
stop-frame feature 
1 subject 


17 


X 


X 


X 


X 


12 


X 


1 



TABLE 8. NOTES 



1. No occasslon of Improper wheel seating occured. 

2. An occasslon of Improper wheel seating occured. One Instructor 
recognized It from video evidence. All Instructors agreed that 
the error could not be reliably observed through the monitors. 

3. Camera 4 was zoomed back for a general view except when Inspecting 
for criterion 5 (wheel nut). Wheel nut placement was not visible 
In ambient lights except by zooming to maximum detail. 

4. This single frame ^ zoomed view gave adequate resolution of the drain 
hole I pneumatic hose^ and splines. Subject movements were confus- 
ing^ because data presented at the monitor were limited to hand and 
tool movements. Those movements seemed Incoherent when larger body 
movements were not clearly known ^ or were blocking the monitor vlew« 
When camera 1 was zoomed back to where body movements were coherent ^ 
criterion detail points were not clearly dlscemable. 
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5. Camera 4 was not used except on call,( to yettfy wheel nut placement 
(criterion 5) ; therefore no wmltor was available through vhlch the 
Instructors could see a general view of the trainer and of trainee 
actions. Instructors were uneasy during those tines they could not 
see the trainee - typically the tines he was looking at the work or 
studying the T.O. 

6. With no camera offering a general view of the trainer (conmant #5) 
It was not possible to anticipate exactly when the trainee would 
begin to mount the wheel. When he did begin, the Instructor- 
console operator began to pan remote control camera #4 to cover 
this criterion 9 but by the time the action came Into focus the 
trainee had completed mounting the wheel. This (criterion 7) Is 
the process criterion which was more effectively scored from the 
camera 2 position, anyway » since the trainee was facing that camera 
while mounting the wheel. He could be seen (If he performed cor- 
rectly) to look over the wheel, to rotate It until the splines 
matched 9 and then to slide It Into place over the drum. 

7. Criterion not visible^ 

8. All criteria were clearly visible In spite of slight Image loss due 
to cascading. Camera 4 presented only the wheel nut, and Its output 
was set to obscure less than a quarter of the camera 2 screen. 
Since camera 4 was remotely controlled, no difficulty was exper-^ 
lenced by the operator In recenterlng the frame for use of the SE6 
display. 

9. When used without artificial light the SEG display was unsuccessful. 
Low gain signal from camera 4 resulted In near total darkening of 
the comer display and corresponding wash*-out of the camera 2 Image. 
Artificial lighting on the wheel nut corrected this condition. 

10. Only the lower half of the strut side of brake and wheel was visible, 
and not all possible positions of hose attachment could be seen. 

11. The wheel nut was clearly discernible but detail was washed out dtie 
to multiple cascading (camera 4 to SEG-2 to SEG-1). 

12. With no overall view It was not possible to verify this process. 

13. Quality of Information was satisfactory but was slightly degraded by 
recording. Instructors could see no reason for ever using this 
procedure I found reviewing the recording tedlotis, and missed eval-* 
nation points due to Inattention. This followed long periods during 
which the trainee was passive, reading the T.O.^ or off«*camera. 
Actual time spent In significant activity was less than 1.5 minutes 
In a task which took (typically) 12--15 minutes to complete. (When 
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monitoring activity not recorded ^ several activities were in pro- 
gress at any time and the instructors found their attention more 
fully engaged.) 

14. It proved impossible to turn the recorder on at appropriate times 
so as to most economically record all criterion detail (reference 
note 13 above). 

15* Slow (economy) tape speed produced a slightly Jerky in ge, but 
instructors saw no loss of information content* 

16. Speeded replay produced a saving in evaluation time %rith no loss of 
information content. The attention problem in reviewing the tape 
(see 13 above) was less serious becaxise periods of inactivity were 
brief. 

17. Criterion features were recognizable in stopped-frames. Instructors 
saw no need, in this task, for the stop-frame capability, since 
criterion features were fully visible during speeded replay. 
Attempts to use the "fast forward" between stop-frame points did 
not produce any saving in time. 



Btsi COM WMUBff 



Images and threatened to daaage tha ^UMra tubaa. It appaarad for a 

while that no conblnatlon of caaara and li^t poaltlona would ba found 
which would at the aaae time be free of unaceaptable glare, raaolva 
criterion detalla of tha taak, and not Interfere with parfomancea of 
the trainee. Positions of camera and lights ioaedlately below the taak 
were video technically acceptable but obstructed the work. Similar 
lighting difficulty Is certain to occur in any use of the video system 
around aircraft: Because of the highly reflective siirfaces It Is diffi- 
cult to obtain good lighting, and there is a constant hazard to vidlcon 
tubes from stray spots of glare. 

The video technical problem was solved, initially, by camera 2 poal- 
tioned at 2A on Figure 12, with a light actually at ground level (lying 
on the floor) at 8 o'clock from the work, under the wing tank at about 
6 feet. A dtffuser on the light did little to relieve glare, but 
adjustment of the bam door eliminated reflectance from the landing 
gear strut, and paper taped to the underside of the wing eliminated an 
area of glare from that point. Camera 2, in this position, faced the 
trainee as he worked on the taak and was able to monitor criterion 
features at the two ends of the linkage, although intervening structures 
obscured the center of that linkage and most of its length. 

Next, camera 3 was mounted on a lowboy tripod, and positioned by 
the wing tank at 18 Inches from floor level, 5 feet from the linkage, 
and 7 o'clock azimuth (Figure 13). This camera viewed the trainee's 
actions from his left as he worked, and gave a slightly clearer and 
closer view of the linkage. It was hoped that, from this position, 
camera 3 could be remotely controlled to observe elements of tasks 1, 
2, 8, and 10. This proved Infeaslble for two reasons: 

In lowboy mounting, movement in azimuth is limited by interference 
between camera or lens and the tripod legs. 

In panning, the camera tended to pick up points of reflectance 
from the aircraft, and was hard to relocate exactly on the task 
while avoiding bad highlights from the underwing and tank side. 
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It was observed that the remote camera in lowboy mounting is very 
precarloxisly balanced^ since the mounting point and center of gravity 
Is close to the outer legs, and the remote control unit Is heavy. In 
fact, In panning the camera remotely It would be easy to create enough 
tension on the cables to overturn the camera. Two precautions were 
observed: 

Shortening the back leg of the tripod tended to restore the center 
of gravity. 

Passing cables back over the tripod and wing tank created a counter 
tension on camera and tripod. We would have preferred to safety- 
wire or guy the tripod to soine secure point. 

After some experimentation in recording, attem^iLlng special 
effects, and evaluation of options by the Instructors, it wa? deter- 
mined that camera 2 was unproductive, and it was moved from 2A to 2B. 
Camera 3 was first set to frame an area approximately 30 x 30 Inches 
around the task^ an area in which movements of the trainee's upper body, 
head, hands and tools could* be seen with only occasional blocking of 
the work by his head or shoulders. It was later found poFslble to zoom 
in on the task to frame an area approximately 12 x 12 Inches, in which 
the linkage appeared laterally across the monitor screen from lower 
left to upper right, with criterion features clearly observable. 

As happened in the cases of tasks 1 and 5, USAF Instructors parti-- 
clpating as evaluators found that they were able to score existing tests 
fully by iising only the close--in, detailed view of the task and obser- 
vation of the criterion product points. This condition was met by 
camera 3 as its most detailed focus. Nevertheless, as in tasks 1 and 
5, instructors felt \ineasy, and expressed dissatisfaction that they 
were unable to see a broader view. They wanted to see the trainee's 
movements, to have a general view of the task area, and to know what 
the trainee was doing when off -^camera. Much of this off-camera time 
the trainee spent in the immediate area, studying the tech order, 
selecting tools, manipulating and inspecting parts , or studying the 
task area from a point a foot or two off the monitor frame. Camera 7 
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was therefore taken from another task and position at 7B (Figure 12) so 
as to view tiie work area more broadly, from the rear of the aircraft 
and looking over the tall. 

A special effect was constructed on S£G"2, In which the output of 
caaer 3 displayed the linkage^ and output of camera 7 was Inserted In 
a lower comer of the screen. Typlca.\ly a check of the SEG-2 monitor 
would show the student studying the T.O., and only occasionally taking 
action to remove, replace, or correct errors at the linkage. 

A difficulty was Identified: Since access to camera 7 Is through 
the sequential switch. It Is necessary to stop cycling of that switch, 
and use it In the manual mode In order to set up a special effect \jslng 
camera 7. This makes outputs of cameras 5, 6, and 8 not available so 
long as the special effect Is displayed. In any second generation video 
system, consldefatlon shoxild be given to Including an alternative 
switching arrangement. 

It was observed that, as they gained experience and confidence In 
video monitoring. Instructors felt less demand for a general view of 
the task area, and were more willing to score on the basis of product 
criterion features, or In other words on the basis of the detail view 
presented from camera 3 and without the panoramic view framed by 
camera 7. 

7.4.5 Instructor Evaluations On 17 May a group of 6 USAF 
Instructors conducted experimental testing on this task using the pro- 
cedure outlined at 7.1.6 and 7.3.6. Table 9 sumnarizes that experiment. 

7.5 TASK 10 - RUDDER BTJNGEE 

7.5.1 Task Description An artificial feel bungee for the rudder 
control system was located high In the tall surface, with access from 
the left side. The access panel was permanently removed. A number of 
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TABLE 9. EXPERIMENTAL SCORING OF PERFORMANCE TESTS 
BY VIDEO — DOOR LINKAGE 



Subsystem used 


AcceDtabllltv of video Information 


Number of student subjects 


All criteria* 


Camera 3 
Camera 2A 
Camera 7 
1 subject 


X. 1 


Camera 3 
Camera 7 
1 subject 


X. 2. 3 


Camera 2 

Recorded, VTR 2 
1 subject 


X. 3. 4 


Camera 3 
Recorded, VTR 3 
Fast playback 
1 subject 


X. 3. 4. 5. 6 


SEG Display: 
Camera 3 (detail) 
Camera 7 (general view) 
1 subject 


X. 6. 7 



* Notation: X * Criterion was dlscemable on video, and 

Instructors agreed on scoring. 
1 - See note* 



BEST cm mmu 

TABLE 9. NOTES 



1. Having Identical Infornation displayed by cameras 2 and 3, from 
different angles, actually proved confusing. 

2. The subject worked with his body between camera and task area. 
The effect was periodic blocking out of the monitor, followed by 
static display of the task hardware. It was possible to score 
the tests fully In this mode. 

3. This performance was recorded. See Appendix, Video Sample Log, 
Tape 1. 

4. Instructors saw no reason why the test would ever need to be re- 
corded. Scoring the test from the recording made It more than 
previously obvious that process criteria were not Involved, and 
that criterion performance could be recognized from the final 
hardware condition when the task was complete. 

5. No Information was lost by fast playback. 

6. Additional lighting was provided to a total of 1200 watts. Subject 
complained of the heat. 

7. Instructors preferred this display, in which a general view of 
trainee actions was Inserted, quartered at the comer of the moni- 
tor screen, to other presentations. This preferrence was felt by 
the lr.structor8 long after they became accuatomed to not seeing 
trainee gross actions and in spite of the fact that they could 
not explain what Information they acquired from seeing those ac- 
tions. We presume that the general view is used to orient detail 
in its relation to larger perceived events. That is, the mental 
processing by which observers relate the small details seen on a 
monitor are perceived in relation to the total aircraft is assist- 
ed by having a monitor presentation which offers intermediate 
scale orienting information. 
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hydraulic lines , control linkages and other structures were present 
which confused an observer trying to monitor this task from the ground. 

7*5 .2 Test Criteria Same as for the wing btingee (1). 

7*5 .3 Observation This task was experimentally Interesting, In 
part because It Involved high access , use of stands, avoidance of 
Improper footings, and potential safety violations* 

7* 5* 4 Video Technique Camera 5 was set up against the wing tank 
and at 7 o'clock to the task, viewing the rudder bungee* A fully satis- 
factory monitor presentation was achieved without difficulty » using 
ambient light, A 500 watt Incandescent hangar light was located over 
this area 9 slightly forward, to the left and above the tall. Unfor- 
tunately no student was assigned to the rudder bungee task during the 
time of this study, 

7*6 TASK 11 - STABILIZER BOLTS 

7* 6*1 Task Description The right stabilizer was fastened to the 
aircraft frame by three heavy bolts » the heads of which were visible 
(panel removed) In the upper surface at the root of the stabilizer. 
These bolts required Installation of safety wire* 

7.6.2 Test Criteria Proper safety wiring of bolt heads* 

7* 6* 3 Observations The task was selected for study, but like 
task 10 above was not performed by students during the time of video 
experiments* 

7* 6* 4 Video Technique Camera 4 was remotely controllable to 
view the stabilizer bolts, which were eaally visible In ambient light. 
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Wh«n lights were In use In task 1^ precautions had to be taken to shield 
the direct line between those lights and the caxoera as It panned through 
the area* 

7.7 TASK 12 - CHUTE RELEASE 

7. 7.1 Task Description A drag chute compartment was located to 
the lover left of the fuselage under the tall. It was checked by 
closing and faatenlilg the compartment doors, working from the rear of 
the aircraft near ground level, and then ptilllng the drag chute release 
cable from the cockpit to observe that the sprlng-*loaded chute doors 
popped open. 

7.7.2 Test Criteria That the doors lock, and open when the 
release Is pulled. 

7.7.3 Observations The student performance was experimentally 
uninteresting (no failures or difficulties were observed). It was 
Included In study for Its video-technical Interest. 

7.7.4 Video Technique On 21 and 22 May this task was recorded 
using camera 2 from directly behind the aircraft (azimuth 6 o'clock to 
the task), on lowboy mounting at 8 feet, ambient lighting. A perfor- 
mance sample was recorded; see Appendix B, Video Sample Log 6. 

7.8 TASK 13 - FUEL FILTER 

7.8.1 Task Description A door In the belly of the aircraft gave 
access to the Interior of the fuselage at the engine compartment (the 
engine was removed). Just Inside the door, against the fuselage wall 
at the lower right, a large fuel filter lay horizontally. The trainee 
task was to remove the filter from Its housing, then remove and replace 
the filter element. 
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7.8.2 Test Criteria Test criteria were: 
Successfully removing the filter. 

Proper torque of a wing nut in reinserting the element. 
Successfully replacing the filter. 

7. 8. 3 Observations This task was of high Interest because: 

The task was highly Inaccessible. To see It the Instructor had to 
crawl under the aircraft and stand up through the access panel 
(removed). He could not do so until the student moved out. See 
Figures 12 and .16. 

There was no measurable ambient light at the task. 

There was no readily apparent place to position a camera or lights. 

When being performed, the work was largely obstructed by the stu- 
dent *s body and hands. 

The test was highly uneconomical of time and effort. 

Instructors habitually avoided observing the completed task; they 
had the student bring the filter element to them, examined seating and 
torque of the wing nut, and assumed successful reasseiii>ly of the filter 
without inspecting it. When first observed, the filter was loose, pre- 
sumably because the last trainee had not completed the task properly. 

7.8.4 Video Technique Viewing this taak presented special diffi- 
culties. Not only was it inside the fuselage at a point with no light, 
but a man working on the filter obscured it almost totally with his head 
and body. 

An initial attempt was made to monitor the task through a mirror 
motmted just forward of the taski right of the centerline of the air- 
craft, and high in the engine compartment. Camera 7 was positioned 
looking into the open tail and focusing on the mirror (7A, Figure 12) . 
Several difficulties remained; 

Although the filter was clearly visible through the mirror, the 
distance was too great to provide acceptable resolution. 
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The only locations at which a light could be placed to Illuminate 
the task either Interfered with performance of the task^ Interposed 
a light between camera and mirror^ or faced a light Into the 
camera* 

The task was largely obstructed, dxirlng its performance, by the 
student's left arm and shoulder* 

In a second attempt, the mirror was placed over the task and closer 
to the compartment wall, and the camera was mounted to the opposite wall 
of the compartment (Figure 16)* Excellent resolution of the task was 
achieved, and the work was only occasionally screened by head movements* 
Viewed through the monitor the Image was reversed and Inverted, but 
hands and tool movements still seemed natural and were easily Inter- 
preted* The effect was that of a view from above* In this circtjm- 
stance, the psychological effects of the mirror view were minimized* 
Inversion of the image resulted in a presentation in which the subject 
was at the top of the screen and the work at the bottom, but because the 
view was from overhead it appeared quite normal* This was true in spite 
of the fact that, with left**rlght reversal, the filter appeared to be 
installed in a reversed position* This caused little confusion to the 
observers (who rarely saw the filter anyway) once they recognized and 
expected that the aft end of the filter would appear at the left of the 
screen* 

7*9 MISCELLANEOUS TASK - TRIPOD JACK 

On May 22, recordings were made of students operating a tripod Jack, 
shown at the lower right on Figure 13* Camera SB was positioned as 
shown at the lower right* Recordings were made using ambient light. 

7.10 SEQ EXPERIMENTS 

Utility of the sequential switch (SEQ) was studied by a series of 
experiments in which student performance was' scored by observing the 
sequential display of two or more camera outputs « Five USAF Instructors 
observed student activity, and attempted to score tests by observing 
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the sequentially cycling outputs of from 2 to A cameras. Cameras 5, 6, 
7 and 8 were used, under control of the SEQ, at various rates of speed, 
and under varying conditions of control. Conditions under which It was 
(or was not) possible to score tests were recorded, and conments of the 
Instructors were elicited In regard to the utility and limitations of 
this kind of observation. 

Observed were activity at the tripod jack (camera 5) , the aileron 
bungee (camera 6), the door linkage (camera 7) and the fuel filter 
(camera 8). In addition, simulation of SEQ display of a complex task 
was performed by manual switching the outputs of cameras 1 and 2, (the 
wheel/brake assenbly) , pretented as a two-part special effects display. 
The findings of th^s experiment were: 

7.10.1 Distraction It was possible to monitor activity while 
the switch ran sequentially. To do so could be distracting. It was 
much more distracting to cycle through four cameras than three, and not 
at all distracting to alternate two. 

7.10.2 Fast Cycling Rates If It was desired to attend to only 
one task. It was possible to do so with the cycling rate set high (about 
1-1.5 seconds per frame) so that an observer could at any moment effec- 
tively retain In memory a pictorial Image of the last pertinent frame 
seen, for comparison with the next. At these cycling rates, all 
observers were able to effectively disregard two Intervening frames 
(from other cameras) , and most were able to disregard the three Inter- 
vening frames of a full SEQ A-frame cycle. The question was whether 
there was any point In making such observations; If It were desired to 
attend to only one task It seemed easier simply to use one camera, 
continuously presented, using the SEQ In the manual switching mode. 

7.10.3 Intermediate Cycling Rates At cycling rates between 1.5 
and A seconds/ frame It was not possible to observe criterion task 
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features effectively. Such short times of exposure did not permit the 
observer to perform the optical orientation, criterion detail search,* 
and intellectual processing needed to make a criterion judgement during 
a single frame; neither was it dependably possible to reitain an image 
in memory while waiting for the pertinent frame (camera output) to 
reappear. 

7»10.4 Slow Cycling Rates At cycling rates between 4 and 7 
seconds per frame it was again possible for observers to visually ana- 
lyze any one preselected activity, and to recognize any single criterion 
condition. This was true provij id the observer did not attempt to 
attend to more than one activity (camera output). Most instructors 
participating in the experiment were able to recognize more than one 
criterion during a 4 to 7 second frame exposure. Thus, they could per- 
ceive and analyze all three criteria for bungee installation in about 
4 seconds. They were not able to do the same for the eight criteria on 
the wheel-brake task in less than about 12 seconds. Presumably that 
much time is required for successive cycles of criterion recall (remem- 
bering what is to be looked for), visual search, and mental processing. 

7.10.5 Very Slow Cycling Rates At cycling rates about 8-10 
seconds per frame, instructors were able to continuously and sequen- 
tially observe and evaliiate the outputs of all 4 cameras as they were 
presented on the SEQ monitor. That is, they were able, as each success- 
ive task came onto the monitor screen, to recall the criteria to be 
observed, to recognize the proper- improper condition of those criteria 
(except on the complex wheel-brake task) , and to score the tests on 
that basis. However , doing so continuously was impossible. Persons 
attempting to do so eventually became confused, fatigued, and unable to 
tolerate the pressure of the task. It was not until the time of frame 
exposure was raised to about 20 seconds that continuous monitoring 
became tolerable. 
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At these cycling rates (greater than 9 aeconda/fraaM) the length of 
the total cycle Is 32«-60 seconds, and a disadvantage becomes apparent | 

A critical event can occur on any one camera and not be noticed. Thus 
a trainee might reverse and reinsert the door link pin (task 9) incor- 
rectly without its being noticed, or begin an unsafe use of the tripod 
Jack. 

7.10.6 Prolonged Exposures At exposure rates of 20-30 seconds/ 
frame It appeared feasible to continuously monitor 3-4 complex activ- 
ities sequentially, as for Instance in a safety Inspection task. Such 
rates did not appear to be useful In testing. To score any particular 
Item on a performance test might reqtiire, for Instance, waiting up to 
90 seconds in a A camera, 30 second/ frame seqxience. It was much more 
economical under those conditions to switch manually; Instructors 
participating did in fact use the manual switch to access cameras 
selectively when they had specific test items to score. 

7.10.7 Instructor Preference When offered the opportunity to 
select an optimal mode for use in test scoring. Instructors selected 
a rapid cycling rate for task surveillance, and stopped the sequence 
manually to perform scoring. They set the SEQ at approximately 1.75 
seconds per frame. At this rate they were able to maintain cognizance 
of which task sites were active, and to recognize, for Instance, that 
the bxrngee had been removed or reinstalled. Any single change of state 
(as for Instance reversal of an Incorrectly Inserted door hinge pin, 
task 9) could be recognized without manually stopping the sequence. 
Nevertheless they invariably elected to stop the sequence manually and 
to observe the task in a continuous presentation on the monitor while 
scoring test items. 

The existing SEQ switching arrangement was a little uneconomical 
for this purpose. To switch manually to any frame it was necessary to; 
(1) Turn the function control from '•sequential" to "manual", (2) Press 
the sequencing switch from 1 to 3 times to reach the desired camera 
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output. In doing so^ operators frequently Inadvertently switched past 
the desired camera and had to press up to 7 times before achieving the 
desired presentation. 

It would be useful to consider. In any future redesign of the 
system, an SEQ switching system In which each camera output Is repre-> 
sen ted by an Individual switch or button, which, when pressed, would 
temporarily override the sequential switching function. 



156 



BEST copy mum 



SECTION 8.0 POVfER LINEMEN VIDEO TESTS 

The second application of the Video Observation System to be exam- 
ined was In the screening of candidates for the Power Linemen course In 
the Civil Engineering Department. Candidates for that course were given 
a pretest and an Initial screening Interview, to determine whether they 
could adapt to the work. The principle causes of failure In the course 
were lack of coordination and fear of height; therefore a pretest had 
been devised which Involved having each candidate cllob a 50 foot pole 
equipped with climbing steps ("the tower") and a 25 foot pole using 
climbing spikes strapped to the legs. Subject performance was observed, 
and a Judgement was made as to the subject's willingness, confidence and 
"tralnablllty". If these qualities were not eadilblted to the satisfac- 
tion of the evaluator, who was an experienced Instructor, the candidate 
was rejected. 

8.1 OPERATIONAL CONFIGURATION 

The video equipment to be used in this application was disconnected 
from the full console, set up, and placed in the back of a 2 1/2 ton truck 
which served as the operational location. The truck was, of course, 
necessary to transport the equipment, but served further to simulate a 
remote location. Ultimately, such a system would {presumably) be 
Installed in a fixed office location, but such an installation would have 
been too expensive and time consuming to construct for purposes of this 
test. The equipment configuration was that described in paragraph 5.1.2, 
with VTR-3 added. It Included two remotely controlled cameras, three 
recorders, and an equipment bay in which were two camera monitors, the 
switching group, the remote camera controls, two special effects genera- 
tors, and aiidio mixers (not used). The equipment configuration is 
Illustrated by Figure 20, 
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Two remote-control cameras were employed so that a split screen 
with a close up, plus an overall perspective view of the climber and 
pole could be obtained. 

Approximately three hours were required to disconnect the required 
equipment, load it on the truck, transport it one mile, and connect it 
up for operation. This required two technicians and two laborers. The 
truck used had a power lift tailgate, which was essential for safe move- 
ment of the rack moimted equipment. 

A 120 volt outdoor outlet had been installed near where the truck 
was parked for the* purpose of furnishing power to the system. No other 
special arrangements were necessary. The relative location of the 
truck and test area is shown in Figure 17. 

8.2 TEST PROCEDURE 

Once the equipment was set up, the senior NCO who was to operate the 
system was given an orientation on the equipment. His duties consisted 
of operating the two remote cameras (zoom, iris, focus and pan/tilt), the 
intercom (push to talk) , and one tape recorder (remote control) . The 
monitor screen was split in half vertically by a SEG display, with the 
close up view on the left and the overall view on the right. After 
approximately thirty minutes of orientation and practice the NCO was 
familiar with the equipment, and from that point controlled the operation 
himself . 

On the day of the demonstration, seven students were to be tested. 
Normally they would have been tested on the poles by one NCO instructor, 
and subsequently interviewed by the senior NCO of the department. He 
would have available test results in the form of qualitative statements 
and recommendations by the NCO who had administered the test. For pur- 
poses of this system tryout, the senior NCO was present in the truck, 
observing and video recording each candidate's performance. The NCO 
instructor in the field with the students controlled their activities in 
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Figure 17 - Field Layout - Pole Climbing Task 
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accordance with instruction he received over the intercom from the senior 
NCO. During testing the senior NCO observed the candidate's performance, 
and recorded' his comments and evaluation (as audio) on the vldpo tape. 
A permanent record therefore was obtained of each student's performance, 
and of the evaluation made at that tiro. 

8.3* OBSERVATIONS 

The tryout of the system showed that: 

8.3.1 The remote camera which provided an overall view of the subject's 
performance seldom needed to be adjusted, and could have been a fixed 
position camera. 

8.3.2 Viewing the subjects performance through the video monitor was as 
effective as viewing the acti^l performance, and offered a Letter view 
of specific actions. 

8.3.3 The most useful view of the climber was one which framed his whole 
body on the screen, while he was c?', Thing the pole from the side opposite 
the camera. 

8.3.4 Evaluators paid little attention to the output of the fixed posi- 
tion camera which monitored the whole pole (perspective view) while the 
subject was climbing. 

8.3.5 The subject could be tracked up the pole, using the remote control 
camera, with no difficulty. 

8.3.6 Changing light conditions (clouds passing in front of the sun) 
required frequent adjustment of the iris setting, which was critical in 
the bright light. The remote control capability was vital in that regard. 

l60 
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8.3.7 The optimum placement of the camera from a lighting standpoint was 
on a line from the sun to the target. This might mean that any opera- 
tional location of the camera would have to be dependent upon the time 

of day that testing was to be performed. 

8.3.8 Independent evaluations of candidate performance, based on review 
of tape recorded performance (with the audio track comments turned off), 
produced consistent evaluations. 

8.3.9 The slow and speeded motion capability of the Javelin recorder 
offered no advantage to this application, while the remote control capa- 
bility of the Panasonic VTR was useful from a control standpoint. 

8.3.10 It would have been desirable to have the capability to record 
instructions being given the subject, by the NCO instructor, as the 
student atten^ted to climb the poles. This would have been feasible 
with the present system, but was not recognized as desirable in suffi- 
cient time to permit setting the microphones and cabling up. 

8.3.11 Tlie performance tapes were reviewed by personnel from the 
Psychiatric Counseling office, who indicated that such records could be 
of value in their dealing with student personnel who, later in training, 
report themselves to be developing fear of cliinbing. 

8.4 CONCLUSIONS 

8.4.1 The system provided a capability for real time evaluation of 
student performance, and for recording such performance either for later 
fevaliiation or as a permanent record of student performance. 

8.4.2 Operation of the system is easily learned, and does not interfere 
with the evaluation process. 

I6l 
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8.4.3 A functional system could be designed for this application that 
would cost approximately $5,000 for ^uiplnent and installation. It would 
consist basically of one remote control camera and lens, one VTR, and 
one monitor, plus two way. communications. 

8.4.4 It is recommended that a basic equipment system be secured and 
installed for this application. 
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SECTION 9.0 INSTRUCTOR TRAINING VIDEO TEST 

The last exercise conducted by URS /Matrix during the field test was 
an experimental use of the Video Observation System to record the per- 
formance of Technical Instructor trainees during practice teaching. The 
purpose of this exercise was to determine the utility of the video system 
In the training «snd evaluation of new Instructor personnel. The advan- 
tage foreseen was that It would permit the recording of Instructor per- 
formance In front of an actual class, with simultaneous recording of 
student reactions. This was to be done using fixed cameras and a split 
screen display. A feature of Interest In this application of the system 
was that It was to require no operator personnel other than the Instructor 
himself. The Instructor was to turn the system on, teach his class, and 
then remove the tape and take It to his supervisor for review and critique. 
In this way the Instructor's performance before an actual class could be 
evaluated by supervisory personnel wi.thout their having to be available 
at the time the class was actually given, having to review the total 
presentation, or Intruding Into the classroom. It was anticipated that 
such a system would offer an liq>roved method of evaluating Instructor 
personnel, and administrative advantages. 

9.1 THE OPERATIONAL CONFIGURATION 

The classroom available for testing this application of the system 
was In the Civil Engineering Department at Sheppard AFB, Texas (as was 
the Power Linemen pretest evaluation) . The classroom used was designed 
for practical work as well as lecture presentation, and there were indi- 
vidual work stalls along the side and rear of the room. Students used 
these stalls to practice the electrical conduit Installation procedures 
which they were being taught. For purposes of our evaluation, only the 
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lecture portion of the presentations was taped, since the practical work 
portion of the training was a problem akin to that which had already been 
Investigated In the Jet Mechanic testing area. 

* The system configuration used was the partial console used In the 
Power Linemen test (Figure 2), with audio mixers actively employed and 
fixed cameras. The physical arrangement of the equipment is shown iu 
Figure 18. Camera 1, in front of the classroom, was equipped with a 
wide-bangle lens that covered all of the students. Camera 2 was focused 
on the instructor's podium, and the adjacent area to the instructor's 
rig^t. This camera covered the instructor as he moved back and forth in 
front of the class and as he used the blackboard. Desk microphones were 
placed around the room between each group of two students; five micro- 
phones covered the ten students in the class. Cables from the cameras 
• and microphones were strung along the floor, under a door, and across 
the hall to another room where the console, recorders, and monitors were 
located. This arrangement minimized distraction to students and instruc- 
tor; and made the system as non-ins truslve as possible. 

9.2 TEST PROCEDURE 

The scope of this test was greatly limited by unexpected changes in 
school scheduling, as a result of whi^h only a single student instructor 
was available as a test subject. Approximately two hours of lecture 
presentation material was recorded using this Instructor trainee as the 
subject. In addition, a half-hour period of practical work by the stu- 
dents at their desks was recorded, to explore the possible value of 
evaluating instructor performance during such an exercise. This portion 
was not planned, but was conducted since it occurred in the noram course 
of the class being observed. 

The recorded performance tapes were reviewed and critiqued by several 
different groups. These Included the instructor himself, his supervisor 
in the department in which he was assigned, and personnel from the 
Instructor Training Department. The student instructor was asked what 
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information about his performance he could discern from the recording, 
and whether being filmed in front of a live audience, and being able to 
review the students reactions, was of any significant value to him. The 
instructor indicated that he found the film useful, and as a result 
intended to change se;^eral aspects of his performance and presentation. 
He felt that he had exhibited nervousness as a result of being recorded. 
He said he recognized his performance as being overly stiff and formal, 
and that this was due to the presence of the cameras and his concern for 
how his students might react to the situation. He said that he was grad 
ually becoming accustomed to the notion of being recorded, and that in 
another session or two probably would be able to ignore the equipment. 

Supervisory personnel from the instructor's department were asked 
to review files to see if there were any new aspects of instructor per- 
formance that they could discern which were not previously observed, and 
whether they could adequately evaluate instructor performance by viewing 
a recorded sample performance • Two supervisors who viewed the tape 
Independently both felt that evaluating on a sanqpling basis (e.g. moving 
from one portion of the tape to another for a total viewing time of 
15-20 minutes) was not adequate. They felt that they might have missed 
something which would have affected their Judgement one way or another. 
They were able, upon viewing the total presentation, to identify several 
technical errors. 

As a result of this review, supervisory personnel expressed the 
possibility that it would be desirable to have all classrooms eqtiipped 
with an observation capability which could be monitored from a central 
location. They felt that this would provide maximum quality control of 
instruction, with a minimum of intrusion into the instructional process. 
They did not feel that the recorded format, as an alternative to direct 
monitoring, offered any significant advantage from a scheduling or 
evaluation standpoint. 

Tapes of the instructor presentation were also shown to senior per- 
sonnel from the Instructor Training Department. These people had 
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originally suggested the requirement for some method of cepturlng Inetruc^ 
tor performance for later evaluation^ since they had a responsibility to 
monitor the initial performance of graduates, after they were assigned 
to actual training duties in other departments of the schools This was 
difficult for them to accomplish due to the amomt of time required ^ and 
to conflicts in schedule; therefore ^ they were Interested in identifying 
means by which they could flexibly fit classroom observations into their 
schedule* However, between the time of specification of this requirement 
and the time of tryout, there had been a major reduction in the require-- 
ment for new Instructors , and scheduling problems which had existed 
earlier were considerably reduced* 

Upon re\^ewing selected portions of the tapes of Instructor perfor- 
mances , the opinion of the Instructor Training personnel was that there 
was certainly enough information on the tape to make an accurate appraisal, 
and that an opportunity to view the student simultaneously with the 
Instructor was essential. The utility of the system was acknowledged 
in terms of the original parameters that they had laid down; the question 
of where to install such a system, however, was difficult* The Instructor 
Training Department trains Instructors for all departments of the school, 
so new Instructors give their initial classes in a wide number of loca- 
tions* Any one location for the equipment would be unsatisfactory, 
multiple installations would be too expensive, and using a portable 
system would not provide the manpower savings benefits that were the 
basis for the requirement in the first place* While the concept was use- 
ful in terms of the quality of information returned, logistics made it 
infeaslble to apply under the current mode of operation* 

The possibility of permanently installing some type of observation 
system in classrooms was discussed with Instructor Training Department 
personnel* It was their view that such systems would be very undesirable 
from the student Instructor's standpoint, and might make personnel 
unwilling to become Instructors* The idea of not knowing when you were 
being observed was unacceptable* 
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The aim of this experiment was to create an operator^free applica- 
tion In which the Instructor would 8lflq>ly starts stop^ and change tapes 
on the equipment. Nevertheless during this brief test, URS/Matrlx pro- 
ject personnel did Interact with the equipment during videotaping, In 
order to determine what the optimum control settings were, what mix of 
camera views was most useful, and what quality of recording was being 
obtained. 

The most useful combination of views recorded was a split screen 
(SEG) Image, with the Instructor appearing at the top of the picture and 
an overall panoramic view of the students shown at the bottom. Recording 
the output of the special effects generator In this manner provided a 
constant, synchronized presentation of Instructor actions and student 
reactions. Several different combinations of display were tried and 
evaluated. A corner Insert of the Instructor proved to be satisfactory, 
and provided a broader view of activity In the classroom, but the Instruc- 
tor tended to move out of the field of view more readily. A vertically 
split display was of no value, since It did not provide the necessary ^ 
panoramic view of the students. The horizontally split display proved 
most useful, and the best division of the screen was approximately two 
to one, with the top third devoted to the Instructor (head and shoulders) 
and the bottom two-thirds showing the students. 

Sound recording proved a problem due to uncontrolled noise. The 
microphones were high quality, sansltlve, and of the cardlold-pattern 
type. As used sitting on the desk tops, however, twp things happened: 
First, since they were pointing toward the celling, the microphones picked 
up high frequency noise from the air conditioning vents. Second, some 
students had the habit of tapping a pencil on the desk top, causing 
vibrations which were virtually indiscernible to the instructor, but 
transmitted noise into the audio channel. A better Installation of the 
mlcropl jnes would be to mount them overhead, pointing down toward the 
students; fewer microphones could then provide better coverage and pick- 
up. Such an installation was not fsasible to attempt within the time 
of this tryout. 
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9.3 FINDINGS ^ 

Based on observatlona by the project team and by assisting USAF 
personnel, the Video Observation System has a potential for application 
in the training of instructors. Its utility to the instructor trainee, 
in reviewing his awn perforiaance, is clear. Less clear is its veXxxe for 
use by supervisors. 

Tha use of video recording as a means by which an instructor can be 
given feedback from his own performance, after that performance and 
while not tmder pressures of the classroom, is a recognized technique 
which has been demonstrated repeatedly by other experiments. This exper- 
iment demonstrated the effectiveness of the Video System for that appli- 
cation . Furthermore : 

The simultaneous recording and display of class members with their 
responses substantially increased the usefulness of the procedvre. 

The tise of a SEG generated, split-screen display made it possible 
to see both instructor and sttxdent data in a single video channel, 
and to record that data economically on tape. 

*The use of slow tape speed to conserve tape did not substantially 
detract from the procedure. 

An instructor can perform the procedure without assistance of a 
video technician, starting and stopping the recording himself. 

The value of video as it might be used by supervisors was not clearly 
established. The system is technically effective for this purpose, and 
can make it possible for supervisors either to monitor classroom events 
remotely or to review them at a later time. That those capabilities 
have potential payoffs is assumed, but it is not clear how those capa- 
bilities can properly be applied. It appeared from the test that: 

The system is technically effective. 

For review by supervisors, a view of the class in addition to the 
instructor is at least optimal, and possibly essential. 

Use of tha system as a supervisory tool in the existing school 

at Sheppard AFB offers no net advantage. The payoffs do not warrant 

the cost. 
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It is not clear under what circumstances supervisory personnel 
might find recording more economic than real-time monitoring. 

It is clear that a substantial consideration, in planning real-time 
monitoring, is the probability that instructors will object to its 
intrusiveness . 
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SECTION 10.0 FINDINGS ^^^^ ^W/UBl£ 

Findings and observations made during the Phase III field tests 
are sunmarlzed in this section. Notes in brackets [ J identify questions 
investigated, and refer to the decimal coding of Appendix A. Notes in 
parentheses ( ) identify paragraphs of this report at which findings 
were reported in narrative. 

10.1 INSTRUCTION AND EVALUATION - JET AIRCRAFT AREA 
10.1.1 Process /Product Content fQuestion 1.11 

Testing procedures observed in use on the F-lOO aircraft mainten- 
ance trainer were based on objective scoring of product criterion mea- 
sures. It should be emphasized that these tests were highly developed 
measures, in which each point of evaluation had been derived from anal- 
ysis of an end-product hardware condition which a mechanic must achieve - 
from the observable conditions of a ready-to-fly aircraft. The tests 
did not ask how those conditions were achieved; they asked only whether 
the end product conformed with the technical order. Thus the testing 
procedure would appear to have eliminated any possibility that the 
processes by which maintenance tasks were performed were worth observing 
(6.0)(7.0). 

It is emphasized that these tests were professionally made and 
administered, reflected advanced theories of instruction, and were mission 
effective. Nevertheless URS /Matrix personnel identified at least three 
respects in which their rationale was defective or inconsistent: First, 
we found that technical instructors actually applied criteria which were 
not formally written into the tests, but which they recognized as impor- 
tant (as in the case of imstated criteria for the wheel-brake assembly 
(7.3.1 and 7.3.6). Secondly, there were certain measures which were in 
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fact made by observing processes ^ as In the case of the bearing lubrica- 
tion task (6. 3.1, Task 6). In this regard it was found that trainees 
could (and sometimes did) assemble tasks 1^ 5^ or 9 correctly by accident^ 
without being aware of the criteria for correct assembly. Instructors 
were aware of that possibility ^ and compensated for it by asking Informal 
questions of the form *'how do you know that . . .V^ questions which^ 
although not part of the written test^ were in fact considered in scoring. 
Practice in this regard varied widely from one instructor to another ^ and 
from case to case. 

[Question 1.1.1] Critical Product Points; 

Product criterion points for each sub task are identified in 
Section 6.0. 

[Question 1.1.2] Feasibility of Video Scoring: 

Host criteria were feasible to monitor through the video system. 
In general 9 criteria which were ordinarily scored by visual inspection 
were readily scored either by direct video monitoring or from video 
recordings. Minor failures occurred, as in the case of failure to per-- 
celve an incompletely seated wheel assembly (7.3.3)« Some criteria were 
not customarily scored by visual inspection. For instance in the fuel 
filter task, tension of a thumb screen was checked by feel (7.8). In 
this case video scoring was achievable by directing the trainee, through 
the intercom, to display the filter, test the thumb screw tension and 
describe what he was doing. A few criteria, not scored by observing 
product conditons, were not fitted to video monitoring. The inspection 
of landing gear door locks (6.3.1, Task A) was made visually by the 
trainee, who recorded his findings on his test sheet. Observing the 
trainee looking at the doors was pointless. Sc was looking at the doors, 
for their mechanical defects were deliberately built into the trainer and 
were known to the evaluators. The trainee's correct marking of the test 
was evidence of correct inspection. 
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[Question l«l«3j Cain/Loss In Preclaion using Video: 

When technical difficulties had been solved^ no criteria (normally 
scored by visual Inspection) were Identified \rtilch were scored less 
precisely using video. The wheel seating perception referred to earlier 
(7«3«3), was easily made once lighting had been Improved or the camera 
sited at a more oblique angle. Every formally expressed test criterion 
could, In fact, be scored with perfect precision either from the student's 
response or from the completed task. Video neither reduced nor Improved 
the precision of that scoring. However: 

There were a few cases (discussed later at 10.1.2) where the 
technical quality of the Image was reduced after recording or multiple 
cascading. 

A few (mostly mstated) criteria which were process rather than 
product measures were more readily observed using video than otherwise. 

[Question 1.1.4] Gain/Loss In Economy using Video: 

Econoi^r of Instructor effort appeared to be a principle gain 
achievable by the use of video. Because tasks were distributed about 
the aircraft, many In places difficult to observe or access (cockpit, 
underwlng, engine compartment), there were at least 11 points In the 
test at which the Instructor nominally was required to move to the point 
of maintenance and perform a visual Inspection. If the first check dis- 
covered an error, a second check would be required, and for a class of 
ten students the Instructor was expected to make 120 or more determine-* 
tlons In this manner. This was loglstlcally Impractical. Instructors 
evaded the requirement by avoiding some tasks (fuel filter, rudder 
bungee), and by short cutting others. They made casual or long range 
Inspection of the aileron bungee, mooring knots, and fuel filter, or 
accepted verbal assurance that those tasks were complete. As a result, 
during the time of the URS/Hatrlx experiments, they accepted Incorrect 
performances on each of these tasks. 
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The video tests demonstrated that all visual Judgement Involved 
could be made from the video console by a seated Instructor » at substan^ 
tlal savings In time and effort. 

A by-^product of such measurement was greater effective precision 
of measurem at^ since criterion details were presented at the monitor 
In optimum scale » focus and lighting. Errors were xinllkcly to be over- 
lookedi and every completed task was reasonably assured of Inspection. 

Some economy and Improved precision mighty In theory » be achieved 
using video recording . If a task can be recorded It might be feasible 
to score It later^ possibly when time might be saved or a more careful 
Judgement made. In practice this did not appear to be the case. Review- 
ing recorded material was uneconomic because of the time lost In loggings 
manipulating recorders » and searching the tape. No Instance was seen 
when a better Judgement might be made later ^ anu participating USAF 
Instructors could not foresee clrcumstances^ In which recording would 
offer an advantage. 

Further precision of measurement would be achievable by formally 
scoring process points. 

[Question 1.1.5] Process Measurements: 

Process measures were Identified » the Inclusion of which either 
would luprove the testing procedure (7.2) or would formalize and system- 
atize an existing unregulated procedure (7.3) (7.6) (7.B). Video access 
would make such measures practically feasible. Required would be a 
mechanism by which the Instructor can be alerted, sd that he can attend 
to the activity as It occurs. This might be accomplished, for Instance, 
by Instructions written into the test which require the student to call 
In on the Intercom before mounting the wheel on the brake drum (Task 5). 

10.1.2 Student/Evaluator Feedback 
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[Question 1.2.1J Adequacy of Reoedlation: '^^^lABi^ 

Practice was vulnerable to criticism, at a few points , In that It 
resulted In poor learning experience. This occurred In Instances in 
which, due to Inadequate feedback from the instructor, students repeatedly 
practiced error behavior or were unable to recognize tiie criteria for 
correct performance at the completion of the task. Students were observed 
attempting to tie knots for the mooring task without effective models or 
guidance (7.2), and other tasks occasslonally led to random experimenta- 
tion not productive of learning goals (7.2) (7.3). This comment does not 
criticize the many cases in which student performance depended on the 
study of clear instruction given in the Tech Order. 

[Question 1.2.2] Audio Feedback: 

Video surveillance vIl* audio communication could facilitate the 
recognition of students who are having trouble, and make it loglstlcally 
possible for the Instructor to intervene. The existing Intercom system, 
however, is poorly suited for such a task, because it does not permit 
opening a discrete private audio link to any one student. 

10.1.3 Time 

[Questions 1.3.1 and 1.3.2] Time Required for Verifying Tasks: 

It was noL possible to time individual subtasks during this test, 
and the limited student sample would in any case have yielded ttnrellable 
data, but it was possible to make some general observations. Nominally, 
each verification of a subtask which requlies a visual inspection should 
require the instructor to walk to the point of inspection (mean time not 
less than 10 seconds), make an observation (n^iarly Instantaneous), speak 
to the subject or mark his test (8 seconds) ^md return, for a mean trans- 
action time of 28 seconds (7.1). Typical tasks were completed in about 
1.5 trys; when the task was Incorrect on the first try, inspection took 
longer, and relnspectlon was requi.red, raising the mean time per student 
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per sub task to somewhat over a minute ^ not less than 3/4 of which was 
spent walking to the task. Had this practice been actually followed ^ 
tests could not have been conducted In the time allotted. 

Actually observed practice was less formal » more economical ^ but 
less reliable (lO.l.l). Counting Instances in which the Instructors 
made cursory Inspection at a distance or accepted student opinion that 
subtasks were correct » actual Instructor time spent per subtask was 
probably close to 1/2 minute. Instructors had other duties ^ of course ^ 
and not all tasks required visual Inspection at the aircraft. 

[Questions 1.3.3» 1.3.4» 1.3.5] Time Required using Video: 

Some economy of time was achieved using the video monitor. In 
fact 9 most video inspections were too rapid to be measured^ and in video 
monitoring the instructor's time was consumed mostly in waiting for 
criterion points to be reached. As was noted at 10.1.1» increased 
precision of test scoring was a by-product of this condition. Using an 
optimized video system^ a single Instructor could probably administer a . 
test to a class of doubled slze^ conduct a test with twice as many visual 
measurement points ^ or conduct tests in two different arear at the same 
time. ^ 

For remediation performed before the end of a task^ a saving in 
time resulted, again from the instructor's not being required to move. 
He could, for instance, note from inappropriate hand movements that the 
bolts were being installed incorrectly in the aileron bungee (7.1), and 
redirect the po.rformance. Or e again the principle advantage was not in 
the time saved for the instructor, but in the fact that because his time 
and motion was saved he coxild: 

Continuously monitor several subtasks, and actually recognize 
error performance more frequently and sooner. 

Redirect more performances per unit time. 

Prevent Inadvertent drilling of error behavior. 
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A limitation on video capability in thliB regard was that many 
remedlatlons cannot be made from the vi.deo console. It was easy enough 
to verbally redirect the bungee and door linkage tasks, where most errors 
were wrong binary choices ^ but for the student who could not tie a 
bowline knot In the wing mooring task, there was no way to assist him 
except by going to the task and handling the rope. 

[Question 1.1.5] Recording Performance: 

No economy or advantage could be Identified which would resiilt from 
recording student performance and scoring It later. 

[Question 1.1.6] Work Samples for Instructor Training and Rella- 
blllty of Test Administration: 

A major anticipated benefit of the Video Observation System Is Its 
capacity to record performance samples, which can be used to familiarise 
Instructors with correct and Incorrect performances, to practice test 
scoring procedures, and to standardize their scoring of response behavior. 
This Is a recognized technique for liiq)rovlng the reliability of human 
performance measures. Work samples were recorded with the Intention of 
attenqptlng to apply the technique In the Jet Mechanic course; this proved 
Infeaslble for one primary reason: The existing tests, when scored 
according to the nominal procedure, are fully objective and based on 
clearly defined product criterion measures (10.1.1) • The scoring of each 
condition Is clear, unequivocal, and not dependent on judgement; there 
Is no requirement for a special standardization procedure. However, 
certain process criteria were recognized either as being Informally \ised 
In scoring, or as desirable to consider (lO.l.l). Only a few brief samples 
of such behaviors occurred In the mat^.rlal recorded, not enough to provide 
a useful experiment. If a sufficient nimiber of these were assembled, and 
tapes were edited to eliminate non-slgnlf leant activity, a valuable exper«^ 
Iment would be feasible. 
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10.2 INSTRU CTION AND E VALUATION - POWER LINEMEN PRETEST 

10 . 2 . 1 Process/Product Content [Question 1>1>1] 

The two performances being evaluated by this task were similar 
pole«*c limbing tasks In which process Judgements alone were Important. 
Whether a subject climbed a pole was not the question so much as whether ^ 
In doing 30 f he exhibited the qualities of ''confidence/* ^'coordination/' 
"willingness" and freedom from fear. These were subjective Judgements 
based exclusively on process observation. 

[Questions 1.1.2, 1.1.3, 1.1.4, 1.1.5] Video Capability: 

All features of the task normally used In evaluation were fully 
monitorable by video, either In direct monitor or record/reply mode. No 
loss of precision was Identifiable from tise of video. Gains In discrim- 
ination were potentially achievable In that the zoom capability made a 
better angle and magnification of facial features possible, but during 
the test high sky-skin contrast (bright sky lighting) resulted in 
darkening of faces, and the detail of facial expression was no better 
than that visible by an observer under the pole. 

10.2.2 Feedback [Questiong 1.2.1 and 1.2.2] 

Existing procedures required an experienced Instructor on the grotmd 
at the pole to supervise administration of the pretest, to advise and 
direct performance of the task, and to ensure safety of the climber, 
assisting him, if necessary, to descend. This feedback could not have 
been performed from the video console. A live instructor was essential 
at the pole. 

10.2.3 Time [Questions 1.3.1 through 1.3.5] 

No gain or loss of time resulted from video monitoring. 
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10.2.4 Teat Reliability iQuettion 1.41 ^ AWl/Umf 

Teat reliability and reproducibility of th« teat procedure could 
probably benefit from comparative atudy of recorded performancea. The 
reliability of the teat, aa conducted depended altogether on the 
subjective, predictive Judgement of a few experienced Inatructora. 
Theae inatructora were obaerved to differ in their evaluatlona of 
individuals. Given a suitable library of tape recorded performancea, 
those tapes could be used to: 

Compare Judgements from one evaliuitor to another, rationalize 
the basis for those Judgements, and standardize evaluator 
scoring practice. 

Familiarize new test administrators with the procedure, to ensure 
that predictive results can be reproduced in the future, and to 
standardize the test across time. 

Study pretest scoring longitudinally, by correlating acores vith 
acores in training. Particularly, by atudying cases of later 
failure in training to improve the predictive value of the 
pretest. 

A further use for recorded performance was suggested by the school 
staff. For those students who later in training declare fear of clinging, 
or who are suspected of deliberate failure, the tapes may be of value in 
psychiatric counseling. Personnel from the mental health clinic who 
viewed the tapes concurred in that opinion. 

10.3 INSTRUCTION AND EVALUATION - INSTRUCTOR TRAINING 

10.3.1 Pro cess /Product Content fOuestion 1.1. 11 

Classroom teaching is a complex and demanding performance, the 
evaluation of which requlrea attention to a atream of almultaneous events, 
including the behaviors of students. Teaching performance is difficult 
to critique fully because of its complexity; it is difficult to assess 
objectively, and particularly difficult for an instructor himself to 
observe. The product measure of instructor performance is student 
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learning; any specific brief observation Is necessarily limited to 
assessment of process. 

10.3.2 Video Capability IQuestlons 1.1.3 through l.ltS] 

Video monitoring was able to provide all essential details of 
Instructor performance. A gain was recognized In that the presence of 
a TV camera was less Intrusive than a live observer. A limitation was 
that) with a single fixed camera, the Instructor could not move freely 
about the room without going off^^camera. Video reproduction^ both on 
direct monitor and record/ replay » was quite adeqtiate to reproduce all 
video detail of Interest. Audio was noisy during the tests » but that 
noise resulted from a correctable technical problem (9.0). 

10.3.3 Time [Questions 1.3.1 throu^ 1.3.5] 

Mo gain or loss of time resulted from video monitoring. 

10.3.4 Recorded Evaluations [Question 1.4] 

Th*^ single student sample which was available to record during this 
test could not provide the basis for any experimental test. Nevertheless 
the Instructor concerned, two. supervisors, and senior members of the 
training department all were able to recognize a potential value for 
recorded samples of Instructcr performance. 

The value of recordings as a tool by which the Instructor can review 
his own performance, with or without evaluation by a supervisor. Is gener- 
ally recognized. The capability to record student reactions simultaneously 
proved useful In this regard. 

Selected samples of student (teacher) performance could be useful 
as standardization tools, to Increase uniformity and reliability of 
supervisor Judgement In scoring teacher performance, or In training 
supervisors In techniques of evaluation and critique. 
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10. A. 1 video Feasibility Jet Aircraft Area 
[Queatlon 2.1.1J Camera -Access; 

In general^ the feasibility of camera access for all tasks studied 
was demonstrated. There were technical problems in the jet aircraft 
task ^ich were of particular Interest, and we will suggest long**term 
camera access solutions which are more desirable than those used in the 
field test. The area around the aircraft trainer was restricted and 
crowded; points Important to video monitoring were frequently points 
which required unusual angles of view or which were in cramped spaces. 
Most importantly, the hardware being examined was typically positioned 
among other parts and assemblies which confused the video presentation, 
or obstructed the direct view. All these conditions made the Jet air- 
craft trainer a particularly challenging test of video technique. 

Solutions were relatively straight-forward, and were achieved with- 
out difficulty except for problems with lighting (7.3) (7.A) (7.10), and 
with Task 13, Inside the engine compartment (7.8). This relative ease 
of solution resulted in part from the use of a light, compact^ slflqple 
but relatively high quality camer . in conjunction with a very good zoom 
lens . 

In the actively used areas under wings and around the landing gear, 
problems were encountered due to the interference between floor-mounted 
cameras and personnel performing maintenance tasks. Thus a camera \ised 
w view the aileron bungee (Figure 12, camera 6B) prevented normal per* 
iV>rmance of the wheel chock task, and the decision not to monitor that 
task was due in part to the fact that the camera would have been in the 
way (6.3.1) « This difficulty would not be particularly Important in a 
permanent installation. In a permanent video monitoring system the 
cameras presumably would not be tripod mounted, but would be permanently 
mounted to the aircraft or other supports, enclosed to protect the 
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cameras, and connected electrically by permanently Installed wiring. 
Thus It would be possible to use the space above, below and within the 
wing tanks and the underface of the wing to mount cameras which would be 
completely out of the way, and yet achieve superior angles of view, for 
Tasks 1, 2, 3, 8, and 9 (figure 12). 

For access to confined aild/or dark areas, more elaborate approaches 
are necessary. Task 13 (Fuel Filter, 7.8) required fixed mounting of a 
camera inside the aircraft and use of a mirror; had space not permitted 
that solution, provision could have been made (in a permanent installa- 
tion) for letting the camera lens through a hole in the fuselage. 

In areas where there is a confusion of parts competing for atten- 
tion (7.1) (7.4) careful camera placement and lighting focus can assure 
the highlighting of criterion hardware features. In an extreme case, a 
permanent installation could Include differential painting of significant 
and non-significant structures, or of parts and background. 

Camera access in the pole climbing and instructor training tasks 
was not a problem. 

In summary, URS/Matrix staff saw no situation in which a task, which 
can be examined by a live observer, would be impossible to access using 
the Video Observation System. 

[Question 2.1.2] Obstructions: 

The tasks studied in the aircraft maintenance area required trainees 
to use hands and tools in confided spaces, with the consequence that 
visual access was likely to hn blocked by hands, tools or body. A person 
performing mechanical work against a flat surface (such as an aircraft 
fuselage) blocks the line of sig:it for approximately 90°, leaving only 
about a 45° oblique access angle on either side from which the work can 
be seen. In any case, the work ic; likely to be periodically blocked by 
hand •movements, and it is difficult to select angles which will not 
at one time or anothev be completely obstructed. For example: 
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Task 1 (Aileron Bungee) and Task 9 (Door Linkage) were typical 
taaka which could be viewed obliquely but atlll were occaaalonally 
/ obacured by a body, head or ahoulder. It waa poaalble, however, 

to view activity In progress wore than 902 ot the tine, and In 
every case to recognize proper taak completion. 

Task 2 (Wing Mooring) waa a particular problem, since a subject 
could tie the knot facing In any direction. It was necessary to 
direct the subject to face the camera. 

Task 13, on the other hand, was a case In which, because access to 
the work was highly constrained to begin with, subjects were rarely 
able to move so as to restrict view from the camera. 



[Question 2.1.3] Camera Requirements - Product Criteria: 

For every single end-product criterion condition being tested (In 
the aircraft maintenance testing problem) It was possible to display that 
condition as the output of a single camera. In all cases but one (Task 5) 
It was possible to frame all criteria applying to the task on a single 
fixed camera. 

In the one Instance In which a single task was presented as two 
vi&ta from different angles, viewers found the additional Information 
more confusing than helpful (Table 4, note 1). 

In cases where remotely controlled cameras were used to view product 
criterion detail for more than one task (7.2) (7.3) (7.4), viewers found 
that to do so reqvilred a cumbersome process of remote search and focus, 
and the hazard of Intercepting excessive levels of light. 

In a case In which remote zoom was used to pick up a product cri- 
terion (7.3.4) viewers found It feasible but cumbersome to do so, since 
It was necessary each time to adjust the Iris and focus as well as the 
focal length. 

The one case In which more than one camera waa required was that of 
the wheel-brake trainer (Task 5) , a case In which several criterion 
details were concerned, located on both sides of the wheel assembly. 

in the pole climbing and Instructor training problems, process 
rather than product measures were Involved. 
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{Question 2.1.4J Caioera Requirements ^ Process Observations; 

The camera requirements Jiist discussed, for viewing end-product 
conditions In aircraft maintenance^ were undem^adlng and were normally 
met by single fixed cameras because ttiey were defined by static hardware 
conditions. Process observations were more demanding. 

In three Instances, special provisions were made to provide a 
broader view of the task area than was nominally required to see cri- 
terion test features • These views, which showed the task In relation 
to Its surroundings, were provided for Tasks 1, 5, and 9, largely 
because of a need expressed by Instructors to see gross trainee move- 
ments and to "know what the students are doing" when they were not 
actually performing operations in the tfisk area. Since students spent 
more time deciding what to do, studying the T.O., and orienting them- 
selves in their problems than they spent actually working with tools, 
these activities were a principle monitoring need. In no case was it 
possible to furnish dependable video coverage of all these actions, since 
the students were free to move about as necessary. It was clearly point- 
less, moreover, to try to follow them about with the remote cameras during 
sueh activity. As a restilt there were substantial periods of time when 
it was not possible to know, from video, what any particular student was 
doing. 

More directly critical to measurement objectives were certain pro- 
cesses which were identified during the field study as useful to observe. 
One of these was in the wing mooring task, where feedback during tying 
of the knot was desirable for pedagogic reasons (7.2). Once the subject 
was directed to face the camera, it was readily possible to frame his 
hands and their adjacent area by camera 4 (Figure 12), and zoom up to 
Inspect the knot. 

At the wheel brake trainer, the useful process measures were 
observing the sequence of tasks, and watching mounting of the wheel (7.3). 
Camera 2, in fixed mountifng, was used to furnish this information reliably, 
as part of a SEG display. 
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Inaertlon of plna and bolts In the door linkage C7«4) vaa a niore 
difficult problem^ Hand Doveoenta could be iiaed to ascertain the appro- 
priate direction of Inaertlon* Moat tralneea performed the action from 
the rear of the wing and thiia vere framed by camera 2; however It was 
poaalble to perform the aame action from the other aide of the aaaembly^ 
In which case camera 2 saw only the tralneea back^ and camera 3 picked 
up the action (Figure 12) « Thus for thla action at leaat 2 cameraa 
would be required to dependably observe bolt Insertion ^ tmless the 
trainee could somehow be constrained to face camera 2 only* 

A very similar bolt Insertion occurred at the aileron bungee (7«l)t 
but In this case» although the trainee might be facing any of several 
directions^ the high oblique angle of the camera to an overhead object 
made It possible for camera 6 to vliw the action In anv event* 

As was observed at 10*2 •If process measures were central In the 
pole climbing task* Two cameras were required^ since It was desirable at 
the same time to have a closeup view of the subject as he climbed thft 
pole^ and to have a more general view from which to follow his progress 
and see his position relative to the ground* Both were remote control 
cameras because^ for the closeup^ It was necessary to follow the subject 
up the pole^ and for the general view It was necessary to pan from pole 
to pole* In any case remote Iris control proved critically liq>ortant^ 
because in the high lighting condition encountered ^ Iris settings 
required constant adjustment* 

As was observed at 10* 3» process measures were observed In the 
Instructor training problem^ and two cameras were used: One to frame the 
Instructor^ and one with a wlde-an^,le ler*-^ to view student reactions* 



[Question 2*l*5j Lighting: 

Lighting proved to be the most difficult and limiting condition* 
The Video System Is supplied with 600 watt Incandescent TV lights » which 
are adequate for moat anticipated needs but which t during the aircraft 
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maintenance tests, produced glare and sharp reflectances from the alum- 
inum aircraft surfaces, bright enough that even brief exposures could 
have produced bums on the camera tubes (7.1) (7.6). 

In general the video equipment produced adequate resolution of 
work detail, without artificial lighting, when ambient light was within 
the range 20-200 footcandles at working surfaces, and within distances 
of 5-25 feet. Work including fine detail, or very low ranges of mono- 
chrome contrast, required higher threshold levels of lighting. 

Highlighted areas appearing within that range - at levels from 
60-200 candle power depending on iris settings and size of the highlighted 
area, had the effect of degrading the image. Depending on how the signal 
was processed at the console, that degradation appeared as a wash-out, 
blackening, or loss of detail in the monitor presentation, resulting 
from the effects of amplification and automatic signal level control 
(7.1) (7.3). 

Highlights which did not prevent adequate resolution cf an image 
at first amplification, as shown by the camera monitor, caused degrada- 
tion of the signal when it was processed by further switching, generation 
of special effects, or recording. In particular, signals from poorly 
lighted targets resulted in blanking or blackening of special effects 
(7.3) (Table 3, note 9). This means that artificial light may be 
required for recording or special effects, when for the same case it is 
not required in direct task monitoring. 

Highlights could be controlled, normally, by control of illumina- 
ting sources or adjustment of camera position. Occasslonally a single 
bright spot could simply be blocked or. covered over. Glare from a wing 
tank surface was controlled by taping a piece of paper over the area 
concerned; in a permanent installation the same area might be covered 
with a matte finish paint. 

The lights furnished with the video system had barn-door shutters, 
which could be used to shield areas of the target field from direct light, 
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and had screen dlffusers to reduce glare. These excellent lights were 
designed for TV or cinema photography, and they produced highly desirable 
light and shadow contrasts on many surfaces. This was not an advantage 
in illuminating technical and mechanical targets, like an aircraft, which 
contain highly reflective surfaces. In such cases a more diffuse light 
source is indicated. It is recommended that, in designing any permanent 
training application around aircraft, special lighting be constructed 
using fluorescent tubes in diffusing fixtures. 

When artificial lighting was used, students complained of discomfort 
due to heat (7.1) (Table 4, note 6). This is another problem which 
fluorescent lighting could relieve. 

Background highlighting and bright spots were a different kind of 
problem. During the field tests, problems were experienced due to the 
appearance of overhead building lights in the picture field, and of 
sunlight glare from floors and windows. When the level reached about 
200 candle power at the surface, a camera at maximum iris opening picked 
up enough highlight to result in an after-image persistent for about 
40 minutes (7.3). 

Regarding lighting see also 7.1, 7.2, 7.3, 7.6, 7.7, 7.8 and 
Table 7, note 3. 

[Question 2.1.6] Resolution and Discrimination: 

In all cases the system was able to provide levels of resolution 
and discrimination appropriate to the uses tested. Problems and observed 
limitations of the system included three of significant interest: 

First, a problem of field contrast: At least two aircraft mainten- 
ance tasks - the aileron and rudder bungees, presented low contrast 
targets with a confusion of irrelevant detail. In both cases adequate 
resolution was achieved at the camera monitor when appropriate camera 
angles were found (7.1) (7.5). A different problem was presented by the 
pole climbing task, filmed out of doors in brigl.t sunlight: At distances. 
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a figure climbing, the pole was seen almost as a black silhouette against 
the bright sky; even In closeup, facial expression was poorly visible 
against the contrasting brightness of sky. Future experiments might 
attempt using a red filter In such applications (8.0). Field contrast 
posed no problem In the classroom monitoring task (9.0). 

There was also a problem of small detail: Small details were 
critical In aircraft maintenance Task 1 (bolt position In the aileron 
bungee) , Task 5 (spline alignment and wheel seating) and In Task 9 ^bolt 
and pin heads on the door linkage). Good resolution was achieved on 
significant details as small as 3/8 Inches at a distance of 8 feet, and 
non-slgnlf leant features of less than 1/10 Inch could be distinguished, 
provided the light was good and the color contrast adequate. The single 
observed failure to resolve detail was a case In which one student failed 
to seat the wheel solidly, and the deficiency was not dependably visible 
at the monitor. It Is concluded that some details might require enhance- 
ment by special lighting, camera angle, or painting details of the 
hardware. 

A final problem was degradation In switching, special effects and 
recording: In recording and replay, the output of camera 5 (Task 10, 
rudder bungee) lacked, resolution of detail. This resulted from the 
weaker and more diffuse light at the rudder surface, with an absence of 
defining highlight and shadow. It Is concluded that, for some conditions 
of field contrast which can be adequately viewed by direct monitoring, 
additional light or other video technical enhancement may be required to 
produce a quality recording . Switching and special effects generation 
were observed, for all subject matter, to result In less severe signal 
degradation, especially for subject matter of low contrast. 

10.4.2 Supporting Audio 

[Question 1.2.2] Audio Monitor-Record: 

No requirement was seen for the audio monitor-record capability In 
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the aircraft maintenance area. , In fact, the high ambient noise In that 
area would effectively preclude sound recording. 

It has been assumed that no need for audio would exist In the pole 
dlnbing task, except to Identify content of the tapes. After observing 
that activity and monitoring It experimentally, that assumption changed. 
During the climb, an instructor on the ground gave Instructions, guidance 
and encouragement which would have been useful to the record, and he 
could have provided student names. If a permanent installation were to 
be made. It Is suggested that instructors might be given a hand or 
headset mike output of which can be mixed into the audio record channel. 

[Question 1.2.2] Intercom Capability: 

The Intercom was used, with only limited success, in attempts to 
control the stopping and starting of recording at critical sequence 
points (Table 7, note 3). Less formal but equally unsuccessful e3q>erl- 
mental use was attempted at the wheel trainer, in which trainees were 
asked to alert the console before beginning key activities. In both 
cases the procedure failed for a variety of reasons. Trainees were not 
familiar with the system; they had difficulty using it, forgot to call 
in, and preferred to come to the instructor anyway. Too many people 
were active In the area, and there was confusion at both the outstatlons 
and the console as to who was calling or being called. Nevertheless a 
clear need was seen for an intercom system to perform alerting tasks. 

To optimize Instructor time, each trainee should call in at those 
points In the sequence at which he either needs guidance or Is ready for 
product evaluation. This would eliminate most need for continuous obser- 
vatlon, and permit cameras not on contlnoiis monitors (those on the SEQ) 
to be switched In as needed. Instructions to call in should be written 
Into test documents (Table 7, note 4). 

An example of successful use occurred at Task 13 (Fuel Filter). A 
student was directed to complete that task without bringing the filter 
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out for inspection. After completing removal of the filter he simulated 
changing the filter element, then called in The console verified 
verbally that the element had been changed, asked the student to show 
the open end to the camera, and to demonstrate and describe correct 
"finger-tight" torque on the thumb screw. The student then reassembled 
the filter, and called in again to have it Inspected. 

Various alternatives to the present sound system might be cons id-- 
ered. There Is a need for the console to be able to recognize which 
station is calling. There may be a need to speak to more than one 
station at a time. For applications in which che sole need Is to alert 
the console operator to an evaluation, a buzzer system might do as well 
as audio, or one**way audio might suffice. Finally, confusion and noise 
would be reduced if the audio stations (in a permanent installation) 
were plug-in points for individual headsets. 



10. A. 3 Subsystem Capabilities 
[Question 2.3.1] Sequential Switch: 

The Sequential Switch was useful under certain conditions for 
monitoring activity in progress, but in most cases seemed not to be the 
optimum means of camera access. In several cases the fact that access 
to cameras 5, 6, 7 and 8 was available only through the SEQ reduced the 
utility of those cameras. These findings are described in detail at 
paragraph 7.10. 

[Question 2.3.2] Special Effects Generatot: 

The Special Effects Generators (SEG*s) proved extremely valuable 
in condensing the information from two or moi^e cameras for presentation^ 
within a single frame. 

In aircraft maintenance tasks ^ a recurring need was expressed to 
at the same time see an overall view of the task or area, and the specific 
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details of the teak. Thia was repeatedly achieved b/ Inserting a aaall 
overall vlew^ as a comer-<screen display, on • trtam containing the 
detailed task (7.1) (7.2) (7.3) (7.4) (Table 7, note 5) (Table 8, notes 
9, 10, 11, and 12) (Table 9, note 7). 

An experimental 3 caaera dlaplay vaa generated In which three views 
of the wheel-brake task (7.3) were conblned. Outputs of two caneras were 
combined on one SEG, and then cascaded.as one Input to the second SEC. 
The resulting display was effective but produced a degraded second-stage 
Image (7.3). 

In the pole climbing task, the SEG display made it possible to see 
the subject's general position on the pole at one side of the screen. 
Juxtaposed to a doseup of the subject as he climbed the pole (8.0). 

The generally observed tendency of signal quality to be reduced by 
successive switching and cascading (typical: camera 6 to SEG to SEG to 
switch group to Recorder 1) resulted In some reduction In information 
for any signal processed by a SEG. The results were most obvious when 
recorded - that is, a signal recorded directly from a camera had better 
picture quality on replay than the same signal recorded as a SEG display. 
Signals from poorly illuminated targets were particularly degraded by 
the SEG. In Instances where a poorly lit target was Inserted onto a 
strong signal, one or both suffered darkening, wash out, or blanking of 
detail (7.3). 

Cn the other hand, SEG displays could effectively double the infor- 
mation content of recordings by combining two camera Inputs in a single 
record channel (7.1) (7.2) (7.3) (7.4) (8.1). In the Instructor training 
tasks, a SEG display was particularly effective. Success in that task 
(as Intended) required a simultaneous view of Instructor snd of class 
reactions, within a single video channel. The display was horizontally 
divided with the instructor (head and shoulders) at the top, and class 
(wide angle) at the bottom (9.0). 
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[Question 2.2.3J Renote Fan/Tilt; 

The remote pan/tllt capability was uaeful in tracking moving actions, 
and in adjusting camera angle to recenter the image for S£G displays. It 
was used less effectively to provide on^call video coverage by panning 
from one sub task to another. 

In the aircraft maintenance task, cameras 3 and 4 were stationed 
80 as to provide remotely controlled, on-^call access to several subtasks. 
Camera 3, on lowboy mounting, was to have accessed features of Task 1, 
Task 2 at the left wing, Tasks 8, 9, and 10. Camera 4 was to have 
accessed Task 1 in overall perspective. Task 2 at the right wing, the 
wheel side of Task 5, and Task 11. It did not prove possible to use 
camera 3 as planned, in part because the lowboy mounting did not give 
sufficient clearance around the tripod legs to permit free motion of the 
pan/ tilt mechanism. There was danger of damaging or breaking off the 
lens asseinbly by torquing it against a leg, or of upsetting the tripod 
by shifting its balance (7.4). 

In atteiq>ting to remotely direct camera 3 toward the rudder bungee 
(Task 10) a new danger was identified. It was possible to inadvertantly 
pan across intense light sources (such as the 600 watt lamps) and to 
damage the vidicon tubes (7.4). In outdoor use (8.0) , there was the 
corresponding and more serious danger of directing a camera towards the 
sun. 

Remote control was particularly valuable in constructing SE6 pre- 
sentations. To center the appropriate action on that part of the camera 
frame which was inserted onto the SEC display , it was necessary to realign 
the camera, and frequently to readjust zoom and iris controls. For every 
adjustment of function and wipe settings, a further adjustment of azimuth 
and elevation was needed. The remote capability made it possible to 
perform these adjustments rapidly, from the console, and within view of 
the SEG monitor (7.2 (7.3). 
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Thtt renot* cApablllty did aake It possible for caaerA 4 to strve 
four t«tk« CI, 2, 5, and 11), ]|t WM cunbersone, however, to nove fro» 
task to taek, an operation which uaually required aone aearchln$ in 
azimuth and elevation, followed by readjustment of focus, soom and iris 
controls. This cannot be reconnended as a practical means of covering 
different points in an actively changing taak setting. An experiment 
at Task 5, in which camera 4 attempted, on call, to record students 
mounting the wheel, resulted in repeated failure to realign the camera 
in time to catch the action concerned (Table 8, note 6). 

The remote control was useful, and in fact was required to make 
possible the pole climbing tests deacribed at 8.0. 

[Quest 2.3.4] Remote Zoom: 

The remote zoom was useful, and is sn essential adjunct to other 
remote controls. It did not prove practical, in one experiment, to tise 
that control to provide alternately detailed and perspective' views of 
the wheel assembly subtask (7.3). 

[Question 2.3.5] Remote Focus and Iris: 

The remote focus and iris controls were useful as necessary adjuncts 
to other remote controls, since changes in azimuth, elevation and zoom 
frequently required readjustnent of focus and iris (7.3). The iris 
control, particularly, was of value in adjusting to changes in light 
condition which were frequent under some circumstances (8.0). 

[Question 2.3.6] Mirrors: 

The use of mirrors was demonstrated successfully, and m^de it 
poisible to monitor a fuel filter task which otherwise could not have 
been framed by a camera. Mirrors are of value in confined spaces, or 
where very narrow clearances exist between structures or structures and 
operators, through which a task must be viewed (7.8). A consideration 
is the fact that a mirror image is reversed. 

193 



BEST cow AVAIIABLE . 



10.4.4 Recording and Replay 

[Question 2.4.1] Mechanically Controlled Recorders; 

-The mechanically controlled "Javelin" recorders are actuated by 
function keys set Into the tape transport deck; they have the capability 
to record either at slow or fast tape speeds, and to produce speeded 
or slowed motion and stop-action. They operated reliably In all 
functions. Limitations were observed in their use at standard tape 
speeds: They were relatively difficult to actuate; careful, firm 
pressure was required to ensure that keys remained locked once depressed. 
Controlling the tape deck required enough effort and attention to detract 
from other console tasks; on occassion, action was lost due to the time 
required to start the recorder (Table 8, note 14). 

Signal degradation (which is expected in video recording) was 
greater with this recorder than with the "Panasonic," and more degrada- 
tion occurred in the record-replay process than in other subsystems of 
the video monitor. Signals which were in any way defective at input 
(as for example from poorly lighted subjects) , recorded very poorly 
(Table 8, notes 8, 11 and 13). 

When starting and stopping, the deck stresses the recording tape 
sufficiently to slightly deform the tape. As a result any point in a 
recording at which the tape had been stopped (as for instance to exer- 
cise the stop-frame function) tended to eadiibit a synchronization flicker 
on further replaying. 

Running the motor for any extended time when the transport is 
stopped causes local wear on the tape surface, since the magnetic 
material continues to bear against the rotating head. This made it 
convenient to use the "Javelin" in any application other than continuous 
recording or replay; in intermittent use it is desirable to turn off the 
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witch Mch tlat recording or play It Intern^tftd. To start again, tha 
■otor wmt ba awttchad on, and glvan tim to gain aynchronoua apaad, 
bafora tha tapa dack la actuated* 

iQuastlon 2.4.2J Baaotaly Controllad Racordarit 

Tha raaotaly controllad "Panaaonlc" racorder vaa leas flaxlbla In 
function but much aaalar to uaa» and aada a aiqparlor recording. Racord- 
raplay degradation vaa a llaltatlon, but vaa laaa aevara than In tUe 
ca^a of tha "Javalln". Tha convanlanca of puah-button function control 
vaa of graatar valua than ai^ctad (8.0). Finally, alnce this tapa dack 
haa a provlalon for autoaatlcally lifting the tape off the recording head, 
tape vear during 8tand«<by periods vaa not a problem. 

[Queatlon 2.4.3] Slow Tapa^peed Recording: 

In aeveral applications, atudylng aub tasks of the aircraft naln- 
tenance task and In Instructor training. It vas found that no significant 
loss of Inforaatlon resulted from recording and replaying action at the 
alov tape speed of 7 fraaea per second (Table 8, note 15) (Table 9, 
note 5) (9.0). This economy produced a slightly flickering and dlacon- 
tlnuous motion, but evaluation criteria vere fully dlscemable. In the 
pole cllnblng task, hovever, vhere Judgement of body coordination vas 
critical, full speed recording vas required (8.0) . 

[Question 2.4.4] Stopped Action: 

Stopped action vas demons Lrated to be an adequate mode in vhlch to 
examine most maintenance tasks - or any task in vhlch product criterion 
Is applied in the coi^lete absence of a process observation. Hovever, 
due to the inconvenience of searching the tape to find criterion points. 
It vas deemed more economical of time and effort to revlev maintenance 
tasks using speed motion (Table 7, note 9) (Table 8, note 17). As has 
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been noted, in stopped-fraae node the playback head continuously turns 
against the sane aagnetlc tape face, causing significant wear on the 
surface. 

[Question 2. 4. 5 J Sloired Action: 

Although there are laiown applications for slowed-action replay, 
none were found which were of advantage during the field test. 

[Question 2.4.6] Speeded Action: 

Speeded action was found very useful as a aeans of economizing tine 
in reviewing recorded sequences. Speeded notion in nalntenance tasks 
resulted in sone blurring of hand and tool novenents, and a presentation 
which at first seened ludicrous, but was recognised as the optinun neans 
of scoring nost such tasks (Table 7, note 8> (Table 8, note 16) (Table 9, 
note 5). 

[Question 2.4.7] Tape Addressing: 

The autonatic rewind/addressing capability of the "Panasonic** 
recorder was of advantage in that it nade it possible automatically to 
return to the beginning of any predetermined record«id sequence. It did 
not greatly assist in the general problem of finding the address on tape 
of previously recorded material. 
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BMttd on findings th« following roconBcndatlons ar« nadoi 

U.l CBIKgAL 

Tht Vldoo Obi«rvatlon Syitaa has utility in training and in testing. 
USAF should apply tha systaa axparlMntally in additional schools and 
settings. It can ba of valua to: 

o Support training or taatlng operationally. 

o Explore any specifically proposed testing or training application, 
detsndne whether video techniquea can be applied in the aetting 
concerned, and experlaentally detendne what video equipaent 
la optiaal for a peraanent Installation. 

11.2 OPKRAnOHAL SYSTEM - POWER LIMBCH COURSE 

There is a current requireasnt for video support to the power line- 
■sn course (reference paragraph 8.4)* A functional system should be 
provided for that courae, and used laBsdiately in student selection. 
Cost of a basic system configuration as suggested (8.4) is in the 
$5,000 rsnge. That cost will be recovered by a very few instances of 
students either (1) elltelnatad before they fail, (2) saved from improper 
pretest failure, or (3) saved from needless self elimination. The cost 
can be further justified by use in other training applications, and in 
behavioral research. 

11.3 SYSTEM OPGRADI NG 

Future procurement of a similar system, redesign, or modification 
of the present system is likely. It is suggested that in such a case the 
following options be considered: 
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An alternative lowboy canera inountlng be identified which is 
stable when mounting the remote control cameras, and which 
permits remote control movement in azimuth and free movement 
In elevation. 

Alternatives to the present audio intercom system be studied. 
Including headset systems and provision for the automatic 
Identification of the outstation calling* 
Switching be provided by which cameras 5, 6, 7 or 8 can ba 
connected to a SEG or recorder, without going through the SEQ. 
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APPENDIX I 
QUESnONS INVESTIGATED 

1.0 INSTRUCTION AND EVALUATION 

1.1 What Is the process/product content? 

1.1.1 What product criterion points are critical to evaluation of any 
task? 

1.1.2 Which are/are not fully monitorable by video? 

1.1.3 What gains/losses in precision or effectiveness of product crl«- 
terlon neasurenent would result froa limiting testing to video neasure«» 
ments? 

1.1.4 What gains/losses In econony of effort would result from limiting 
testing video measurements? 

1.1.5 Are any significant process measures possible which video measure- 
ment would facilitate? 

1.2 What are the student/evaluator feedback effects? 

1.2.1 Does the present measurement practice provide adequate remediation? 

1.2.2 Could video liq>rove student/Instructor feedback? 

1.3 What times are Involved? 

1.3.1 What approximate mean Instructor time Is required (present methods) 
to perform an Instructor verification of vty correct stibtask? 

1.3.2 What approximate mean time Is required (present methods) to provide 
remediation and achieve criterion performance, when subjects e^lblt errors 
or Incompetence on the first try? 
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1.3.3 What approximate mean time la required to verify correct perfor- 
mance using the video monitor, including any effort required for student 
contact or direct visual Inspection? 

1.3.4 What estimated mean time would be required to provide remediation, 
using an Ideal video monitor system? 

1.4 Could recorded work samples be used to Increase instructor reliabil- 
ity, or for other ;sval\iative purpose? 

2.0 VIDEOTECHNICAL CAPABILITIES AND OPERATOR LOADS 



2.1 Video feasibility. Is it technically feasible to monitor or record 
critical (criterion) elements of specific tasks, using the experimental 
video system? 

2.1.1 Access. Can cameras gain video access to the task? 

2.1.2 Obstructions. Are limitations on visibility imposed by blocking 
by the subject, his hands, tools, or aircraft structure? 

2.1.3 Camera requirements - product criteria. Can all product criterion 
features be framed by: 

o a single fixed camera? 
o 2 or more, fixed cameras? 

o remotely controlled (tilt, azimuth, zoom) cameras? 

2.1.4 Camera requirements - process. Can all process (activity) features 
of the task be framed by: " 

o a single fixed camera? 
o 2 or more fixed cameras? 

o remotely controlled (tile, azimuth, zoom) cameras? 
2.1.6 Resolution/discrimination. Are limitations imposed by; 
o lack of field contrast? 
o smallness of critical detail? 

o degradation of image in switching, special effects or recording? 
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2.2 Supporting Aodlo. la supporting audio useful or required? 

2.2.1 Is sudlo monitor or record capsblllty needed (cost-effective) 7 
o Whet operator loads are laqposed by use of the audio oKmltor/ 

record capability? 

2.2.2 I" Intercom capability needed: 
o to call work stations? 

o to call the control console? 

o to pass criterion (test) Information? 

o to control recording? 

o What operator loads are Inposed by use of the Intercom system? 

2.3 Subsystem capabllltleiB. What are the utilities and limits of 
specific subsystems? 

2.3.1 SEQ. Can cameras 5-8 be set up, monitored and applied to measure- 
ment tasks using the sequential switch? 

o For what Is the SEQ useful? 

o What limits does It Inpose? 

o What additional operator load Is Imposed by monitoring cameras 

and tasks through the sequential switch? 
o What switching speeds are effective for what applications? 
o How many tasks can an operator keep under surveillance through 

the SEQ? 

o What operator load Is Imposed by operating the manxial switch? 

2.3.3 Remote pan/ tilt. Using the remote control pan/tllt capability of 
cameras 3 and 4, can the console operator capture video Information not 
otherwise viewable? 

o Can he follow moving action In azimuth and elevation? 
o Can he pan from one subtask to another? 
o What uses apply? 

o What limitations has this capability? 
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o What operator load Is Imposed by remote control of azimuth and 
range? 

o What are the cost/benefits In following a moving target? 

o What are the cost/benefits In panning between two targets? 
2*3.4 Remote zoom. Using the remote zoom and focus capability, can the 
console operator capture video information not otherwise viewable? 

o Can he change content of the video frame to Include changing 
levels of detail? 

o What iises apply? 

o What limitations has this capability? 

o What are the operator loads and cost/benefits in changing the 
video frame content by use of remote zoom control? 

2.3.5 Remote focus and Iris. Can the console operator effectively 
adjust focus and Iris by remote control? 

o Under what conditions Is this useful? 
o What limitations has this capability? 

o What operator loads are imposed by changing remote focus and Iris 
adjustment? 

2.3.6 Mirrors. Can video access to difficult targets be achieved using 
mirrors? 

o For what applications are mirrors useful? 
o What limitations do they have? 

2.4 Recording and Replay. Is It technically feasible to record and replay 
critical elements of specific measurement tasks, using the experimental 
video system? 

2.4.1 Mechanically controlled recorders. Do the mechanically controlled 
Javelin recorders effectively record criterion product and/or process data 
(at standard tape speed)? 

o What are their capabilities? 

o What are their llmltatluns? 

o What operator loads are imposed by the mechanically controlled 
recorders? 
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2.A.2 R«mote control tttcordtra. Do th« vtaottly ^coatrolUd Pa&Monic 
r«cord«rs •ffectivtly r«cord crlttrlon product and/or proc««« dataT 

0 What are their capabllltiaa? 

o What are their liinitatlonsT 

o What operator loada are tsipoied by the renotely controlled 
recorder a 7 \ 

2.4.3 Slow tape-apeed recording. Can video data be effectively recorded 
end replayed at 7 fraaea per aecond? 

o For what la thla capability uaeful? 

o yhat limitatlona doea It impoae? 

o .What operator loada are Imposed by alow apeeda? 

2.4.4 Stop action. Can uaeful Information be derived by wing the 
atop-frame capability? 

o What operator loads are imposed by recording and observing stop- 
frame action? 
o Under what conditions Is this useful? 
o What limitations does It Impose? 

2.4.5 Slowed action. Can useful Information be derived using the slowed 
action capability? 

o Under what conditions Is this useful? 
o What limits does It Impose? 

o What operator loads are Imposed by recording and observing slowed 
action? 

2.4.6 Speeded action. Can time be saved by viewing task performance as 
apeeded action? 

o Under what conditions Is this useful? 
o What limits does It Impose? 

o What operator loads are Imposed by recording and observing 
speeded action? 

2.4.7 Tape addressing. Is the automatic rewind/address capability of 
the Panasonic recorder useful? 

o What loads are Imposed by searching tapes for the addresses of 
specific sequences to be reviewed? 
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APPENDIX II 
VIDEO SAMPLE LOGS 



Following are copies of the original 
Video Sample Logs made during the 
field test of the Video System. 
They reflect contents of the perfor- 
mance sample tapes which have been 
furnished to the Air Force. 
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